-- Logs begin at Thu 2022-05-26 16:48:44 UTC, end at Thu 2022-05-26 18:28:44 UTC. -- May 26 17:49:44.096087 dv-cinder-836073-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 17:49:44.109025 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:49:44 2022] *** May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: nodename: dv-cinder-836073-5-iscsi May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: machine: x86_64 May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: clock source: unix May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: pcre jit disabled May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: detected number of CPU cores: 4 May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: current working directory: / May 26 17:49:44.111518 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: detected binary path: /usr/bin/uwsgi-core May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: your processes number limit is 47680 May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: your memory page size is 4096 bytes May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: detected max file descriptor number: 2048 May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: lock engine: pthread robust mutexes May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: thunder lock: enabled May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 17:49:44.112226 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:49:44.157021 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: Python main interpreter initialized at 0x55de0c3939c0 May 26 17:49:44.157021 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: python threads support enabled May 26 17:49:44.157021 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: your server socket listen backlog is limited to 100 connections May 26 17:49:44.157021 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: your mercy for graceful operations on workers is 90 seconds May 26 17:49:44.157572 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:49:44.157572 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: *** Operational MODE: preforking *** May 26 17:49:44.157767 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: *** uWSGI is running in multiple interpreter mode *** May 26 17:49:44.157767 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: spawned uWSGI master process (pid: 115232) May 26 17:49:44.158007 dv-cinder-836073-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 17:49:44.158743 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: spawned uWSGI worker 1 (pid: 115233, cores: 1) May 26 17:49:44.159125 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: spawned uWSGI worker 2 (pid: 115234, cores: 1) May 26 17:49:44.159125 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:49:45.368523 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:49:45.396907 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:49:46.116426 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:49:46.116426 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: from cryptography.utils import int_from_bytes May 26 17:49:46.116763 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:49:46.116763 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: from cryptography.utils import int_from_bytes May 26 17:49:46.132399 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:49:46.132399 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: from cryptography.utils import int_from_bytes May 26 17:49:46.132746 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:49:46.132746 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: from cryptography.utils import int_from_bytes May 26 17:49:48.756715 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:49:48.757443 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:49:48.757568 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:49:48.757812 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:49:48.758182 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:49:48.758277 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:49:48.758368 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:49:48.758457 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.758535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:49:48.758777 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.758962 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:49:48.759120 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:49:48.759230 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.759437 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.759530 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.759767 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.759863 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760078 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760179 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760398 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760500 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760751 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.760845 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761083 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761180 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761319 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761428 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761633 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761728 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.761955 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836073-5-iscsi {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762047 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762258 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762341 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762570 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762667 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762905 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.762995 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836073-5-iscsi {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763225 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763322 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763531 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763624 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763853 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.763945 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.764159 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.764286 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.764543 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.764704 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.764927 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.765092 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.765276 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.765485 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.765799 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.765912 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766141 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766284 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766456 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766592 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766767 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.766928 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767112 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767254 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767421 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767568 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767748 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.767882 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.768086 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.768189 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.768479 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.768788 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836073-5-iscsi {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.768922 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769104 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769204 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769443 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769532 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836073-5-iscsi {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769761 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.769928 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770110 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770193 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770428 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770523 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770787 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.770905 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771132 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771217 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771458 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771561 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771777 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.771869 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772102 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772186 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772413 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772506 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772730 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.772821 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773046 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773129 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773347 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773439 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773658 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773752 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.773957 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774052 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774267 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774354 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774571 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774657 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774900 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.774991 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775154 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775248 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775463 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775548 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775737 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.775836 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776047 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776140 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776440 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776547 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776630 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776720 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.776871 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777005 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777190 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777275 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777494 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777588 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777803 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.777888 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778111 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778261 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778416 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778502 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778721 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.778806 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779049 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779150 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779423 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779534 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779671 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779759 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.779980 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.780140 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.780294 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.780413 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.780613 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.780720 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.781015 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.781114 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.781583 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.781819 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.781920 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782054 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782293 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782388 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782596 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782704 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.782885 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783093 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783242 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783352 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783529 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783648 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783837 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.783967 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784159 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784301 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784491 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784642 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784779 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.784886 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785084 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785206 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785392 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785514 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785711 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.785804 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786034 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786120 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786338 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786421 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786595 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786745 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.786917 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787064 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787225 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787321 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787543 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787639 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787850 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.787947 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788159 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788258 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788472 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788582 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788770 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.788871 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789085 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789234 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789381 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789482 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789686 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789772 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.789993 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.790080 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.790298 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.790398 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.790961 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791067 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791067 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791231 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791319 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791411 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791519 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791620 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791841 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.791941 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792160 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792248 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792466 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792558 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.792860 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793110 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793210 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793417 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793572 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793721 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.793824 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.794026 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.794130 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.794392 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.795118 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.795391 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.795553 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.795790 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.795937 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.796077 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.796227 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.796365 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.797109 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.798965 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799065 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799164 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799250 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799332 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799412 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799583 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799662 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799662 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799815 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799894 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.799894 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800054 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800142 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800220 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800298 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800298 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800457 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800543 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800623 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800701 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800778 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800878 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.800959 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801045 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801124 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801209 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801288 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801374 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801454 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801538 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801624 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.801781 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802097 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802304 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802451 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802589 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802733 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.802889 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.803049 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.803140 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.803211 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.803339 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.803669 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:49:48.803756 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804011 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804096 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804327 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804413 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804662 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804748 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.804997 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.805127 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.805315 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.805401 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.805628 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.805722 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806009 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806168 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806257 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806345 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806570 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806782 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.806982 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807165 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807297 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807452 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807616 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807767 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.807936 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808081 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808266 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808404 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808583 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808725 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.808899 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809048 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809217 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809368 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809527 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809685 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.809845 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810003 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810173 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810317 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810496 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810634 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810807 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.810986 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811172 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811400 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811522 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811611 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811838 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.811952 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.812844 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.812948 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.813285 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.813392 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.813612 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.813792 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.813939 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.814190 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.814289 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.814556 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.814769 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.814944 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.815213 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.815366 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.815551 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.815698 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.815863 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.816122 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.816217 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.816484 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.816687 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.816793 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817018 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817104 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817344 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817456 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817664 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817758 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.817985 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818071 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818307 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818406 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818622 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818718 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.818961 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819054 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819290 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819395 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819604 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819691 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.819920 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820006 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820234 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820397 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820539 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820631 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820845 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.820929 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821148 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821242 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821452 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821541 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821752 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.821844 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822061 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822205 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822368 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822455 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822675 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.822760 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823085 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823186 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823342 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823429 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823685 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.823903 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824033 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824128 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824347 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824478 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824648 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824744 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.824961 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825047 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825266 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825358 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825566 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825658 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825877 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.825962 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826182 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826274 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826482 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826574 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826806 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.826924 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827136 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827220 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827428 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827527 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827787 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.827877 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828104 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828197 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828416 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828727 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.828846 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829043 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829164 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829366 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829480 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829679 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829796 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.829992 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.830123 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.830327 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.830440 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.830657 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.830750 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831039 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831142 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831367 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831444 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831694 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.831791 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832008 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832108 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832312 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832397 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832624 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832709 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.832927 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833022 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833231 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833325 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833534 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833618 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833838 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.833930 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834140 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834226 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834527 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834742 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.834863 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835067 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835152 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835370 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835466 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835672 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835764 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.835977 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836062 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836275 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836359 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836576 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836663 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836878 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.836973 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837180 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837264 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837490 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837615 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837836 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.837939 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838141 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838241 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838470 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838568 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838792 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.838943 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839147 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839285 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839432 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839578 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839750 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.839953 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840176 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840379 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840523 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840655 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840803 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.840949 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841084 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841231 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841366 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841500 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841636 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841769 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.841934 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842033 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842258 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842418 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842564 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842702 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.842906 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843014 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843221 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843329 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843593 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843806 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.843974 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844149 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844312 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844484 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844660 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844803 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.844998 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845125 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845317 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845437 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845641 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845754 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.845953 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846048 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846270 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846363 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846583 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846669 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.846925 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847017 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847241 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847328 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847558 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847678 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847877 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.847978 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848191 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848340 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848504 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848616 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848813 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.848902 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849134 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849218 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849433 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849602 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849745 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.849831 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850045 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850128 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850358 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850451 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850682 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.850765 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851019 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851106 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851338 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851435 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851651 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851736 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.851974 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852061 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852284 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852370 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852592 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852681 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852905 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.852991 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853211 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853304 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853515 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853607 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853822 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.853906 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854133 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854218 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854506 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854606 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854754 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.854929 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855087 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855247 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855401 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855555 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855748 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.855858 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856014 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856157 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856316 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856481 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856632 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856793 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.856955 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857116 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857267 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857437 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857590 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857769 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.857915 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858042 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858220 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858362 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858524 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858672 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.858870 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.859612 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.859730 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860007 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860231 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860327 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860408 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860631 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860716 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.860945 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861037 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861252 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861346 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861569 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861656 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861885 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.861984 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862193 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862276 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862589 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862813 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.862973 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863140 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863226 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863448 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863531 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863764 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.863858 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864073 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864159 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864381 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864475 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864687 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864773 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.864994 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.865076 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.865354 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.865484 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.865734 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.865830 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866013 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866113 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866319 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866406 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866636 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866725 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.866999 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867098 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867293 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867397 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867601 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867688 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.867920 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.868183 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.868486 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.868582 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.868826 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.868924 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869147 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869233 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869471 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869565 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869795 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.869893 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870116 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870210 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870449 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870544 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870782 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.870909 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871114 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871213 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871425 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871524 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871731 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.871825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872036 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872129 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872400 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872486 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872709 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.872843 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873015 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873102 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873320 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873404 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873628 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873727 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.873929 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.874020 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.874232 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.874324 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875218 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875434 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875522 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875591 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875830 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.875989 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876142 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876238 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876452 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876541 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876769 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.876868 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877083 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877185 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877410 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877508 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877724 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.877821 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878026 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878122 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878332 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878429 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878637 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878741 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.878993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879091 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879304 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879391 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879644 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879761 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.879979 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.880085 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.880330 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.880661 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.880848 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.880972 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.881220 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.881428 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.881599 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.881771 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.881884 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.882077 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.882256 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.882342 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.882716 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.883143 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.883338 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.883599 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.883838 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.884001 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.884344 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.884687 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.884902 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885080 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885236 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885411 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885522 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885827 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.885959 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.886030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.886097 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.886397 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.886595 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.886738 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.887094 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.887356 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.887559 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.887775 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.887965 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.888055 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.888165 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.888324 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.888494 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.888640 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889044 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889126 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889291 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889580 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889775 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.889925 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890080 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890195 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890273 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890438 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890577 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890706 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890892 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.890892 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891144 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891224 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891293 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891371 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891440 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891508 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891574 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891649 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891716 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891792 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891860 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891927 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.891993 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892059 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892125 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892253 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892355 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892439 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892439 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892564 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892632 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892711 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892781 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892858 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.892979 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893109 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893192 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893262 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893785 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893894 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.893965 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894031 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894119 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894195 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894288 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894447 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894596 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894757 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.894921 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895097 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895223 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895417 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895531 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895717 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.895814 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896024 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896111 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896331 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896406 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896637 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896732 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.896943 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897028 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897273 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897358 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897571 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897657 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.897877 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898057 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898168 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898476 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898572 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898841 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.898932 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899151 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899237 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899489 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899584 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899808 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.899892 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900121 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900210 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900444 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900551 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900754 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.900841 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901066 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901153 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901384 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901493 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901688 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.901783 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902008 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902095 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902320 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902416 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902622 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902707 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.902957 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903046 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903297 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903401 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903571 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903655 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903884 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.903969 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904198 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904287 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904520 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904615 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904840 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.904954 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905165 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905258 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905470 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905566 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905803 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.905901 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.906442 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.906535 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.906779 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.906901 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907124 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907225 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907440 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907539 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907753 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.907839 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908067 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908167 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908381 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908520 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908696 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.908782 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909007 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909093 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909315 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909408 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909622 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909816 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909916 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.909997 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910218 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910326 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910535 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910620 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910864 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.910958 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911171 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911255 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911481 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911566 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911784 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.911872 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912093 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912220 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912397 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912531 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912837 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.912923 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913139 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913224 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913453 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913566 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913756 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.913841 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914070 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914163 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914479 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914688 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.914772 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915034 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915120 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915343 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915726 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.915810 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916037 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916124 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916343 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916430 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916653 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.916827 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.917107 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.917301 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.917442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.917750 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.917847 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918059 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918240 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918357 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918583 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918682 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.918923 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919013 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919240 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919325 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919553 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919735 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.919964 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.920058 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.920278 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.920391 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.920603 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.920769 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.921026 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.921112 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.921343 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922124 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922212 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922280 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922519 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922604 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.922971 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923083 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923227 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923321 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923544 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923630 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.923855 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924052 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924180 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924274 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924486 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924569 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924799 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.924881 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925109 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925205 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925412 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925497 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925735 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.925820 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926047 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926131 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926356 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926439 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926669 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.926886 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927004 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927091 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927334 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927423 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927656 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927743 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.927983 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928071 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928320 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928405 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928626 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928760 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.928930 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929240 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929336 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929545 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929640 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929851 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.929937 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930180 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930308 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930523 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930671 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930845 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.930937 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931160 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931247 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931488 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931586 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931787 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.931873 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932091 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932177 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932401 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932498 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932700 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.932785 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933004 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933089 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933312 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933413 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933631 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933729 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.933934 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934239 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934325 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934567 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934903 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.934993 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.935209 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.935347 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.935514 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.935658 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.937122 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.937789 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.937963 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938141 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938238 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938318 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938398 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938565 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938653 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938756 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938871 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.938966 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939056 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939137 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939215 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939292 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939369 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939447 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939655 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939755 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.939970 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940057 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940295 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940395 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940638 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940820 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.940982 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941125 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941282 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941440 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941561 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941768 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.941917 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.942158 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.942308 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.942467 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.942616 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.942762 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943009 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943163 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943379 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943546 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943708 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943836 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.943968 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.944208 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.944389 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.944575 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.944749 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.944894 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945052 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945175 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945461 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945592 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945794 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.945942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.946101 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.946300 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.946575 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.946731 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.946896 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947029 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947158 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947388 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947534 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947677 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.947863 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948028 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948278 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948439 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948588 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948756 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.948913 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949124 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949281 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949492 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949638 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949848 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.949993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.950137 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.950274 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.950404 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.950689 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.950872 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951070 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951236 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951387 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951557 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951706 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.951943 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.952109 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.952285 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.952431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.952592 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.952766 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.953105 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.953462 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.953620 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.953835 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.954030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.954180 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.954443 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.954574 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.954770 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.955114 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.955211 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.955431 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.955660 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.955799 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956052 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956209 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956362 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956453 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956676 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.956937 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957061 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957322 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957425 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957653 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957812 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.957997 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.958286 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.958380 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.958619 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.958702 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.958962 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.959144 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.959276 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.959569 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.959654 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.959943 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.960040 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.960250 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.960446 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.960565 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.960901 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961007 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961192 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961349 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961503 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961810 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.961904 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.962120 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.962238 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.962432 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.962642 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.962734 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963062 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963151 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963378 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963504 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963692 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.963976 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.964110 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.964451 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.964550 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.964778 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.964935 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.965092 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.965387 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.965482 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.965713 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.965865 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.966243 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.966343 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.966560 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.966692 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.966921 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967091 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967248 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967548 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967701 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967864 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.967993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.968187 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.968527 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.968678 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.968905 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.969037 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.969297 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.969426 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.969614 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.969889 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970061 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970222 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970350 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970547 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970752 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.970869 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971110 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971215 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971517 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971773 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.971865 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.972303 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.972387 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.972619 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.972717 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.972956 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973054 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973284 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973371 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973616 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973765 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.973922 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974049 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974222 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974322 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974547 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974660 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974871 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.974984 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975181 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975266 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975492 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975575 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975801 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.975912 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976102 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976187 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976405 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976489 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976718 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.976817 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977019 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977110 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977324 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977633 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977768 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.977942 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978161 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978255 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978510 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978605 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978865 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.978955 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.979360 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.979479 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.979801 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.979897 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.979978 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980056 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980132 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980200 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980359 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980448 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980664 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980749 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.980978 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981080 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981282 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981379 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981588 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981673 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981897 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.981994 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982196 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982283 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982592 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982804 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.982909 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983129 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983216 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983437 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983531 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983739 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.983832 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.984579 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.984675 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.984963 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985060 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985323 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985419 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985628 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985712 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.985942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986026 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986251 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986384 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986557 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986667 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986881 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.986994 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.987188 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.987465 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.987564 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.987794 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.987940 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988099 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988239 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988404 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988534 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988810 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.988938 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989078 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989232 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989369 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989509 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989642 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989789 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.989948 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990092 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990265 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990371 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990575 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990663 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.990911 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991004 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991226 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991326 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991545 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991700 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.991866 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992012 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992170 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992295 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992438 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992527 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992745 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.992834 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993055 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993365 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993450 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993675 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993809 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.993983 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.994121 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.994300 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.994421 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.994642 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.994758 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995033 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995152 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995374 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995534 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995685 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995819 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.995970 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996110 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996241 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996370 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996514 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996645 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996792 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.996923 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997144 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997295 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997428 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997557 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997686 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997826 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.997987 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.998131 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.998264 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.998392 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.998574 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.998907 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.999013 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.999156 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.999243 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:48.999479 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.000406 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.000503 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.000583 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.000781 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.000878 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001135 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001221 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001564 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001679 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001761 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.001841 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002089 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002176 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002404 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002498 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002737 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.002851 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003175 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003479 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003592 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003798 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003892 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.003973 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004052 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004365 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004469 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004647 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004735 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.004959 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005045 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005283 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005390 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005591 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005748 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.005896 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006064 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006200 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006384 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006513 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006707 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.006913 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007043 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007139 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007366 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007458 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007689 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.007785 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008003 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008101 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008308 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008392 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008619 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008704 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.008924 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009024 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009229 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009322 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009534 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009619 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009839 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.009934 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010150 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010237 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010458 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010582 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010760 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.010881 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011103 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011203 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011409 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011515 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011780 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.011883 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012044 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012132 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012352 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012445 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012662 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012757 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.012984 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013081 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013272 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013371 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013575 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013669 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013877 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.013962 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014184 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014285 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014484 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014570 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014785 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.014902 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.015109 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.015409 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.015595 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.015681 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.015936 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016124 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016247 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016668 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016822 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.016910 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017139 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017232 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017456 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017549 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017772 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.017857 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018093 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018225 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018427 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018511 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018738 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.018845 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019097 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019201 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019419 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019518 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019738 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.019830 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020056 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020200 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020358 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020443 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020689 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020793 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.020997 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021090 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021307 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021393 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021634 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.021930 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022028 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022242 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022330 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022561 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022646 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.022905 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023008 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023234 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023323 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023560 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023659 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023869 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.023964 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024196 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024282 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024525 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024618 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024839 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.024922 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025167 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025252 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025486 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025580 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025824 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.025916 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026145 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026244 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026454 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026547 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026757 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.026857 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.027033 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:49:49.027133 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.027442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.027758 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.028071 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.028380 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.028699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.029015 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.029342 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.029668 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.029978 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.030305 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.030636 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.031072 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.031643 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.032000 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.032324 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.032639 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.032951 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.033259 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:49:49.033505 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:49:49.087652 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO dbcounter [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Registered counter for database nova_api May 26 17:49:49.093473 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO dbcounter [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Registered counter for database nova_api May 26 17:49:49.110066 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_db.sqlalchemy.engines [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.115189 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_db.sqlalchemy.engines [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.117135 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writer thread running {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.122558 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writer thread running {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.175751 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.context [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aa3fa86-c8c9-4c3d-99e8-137d16582b2d(cell1) {{(pid=115234) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:49:49.179927 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:49:49.181506 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:49:49.181621 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.context [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aa3fa86-c8c9-4c3d-99e8-137d16582b2d(cell1) {{(pid=115233) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:49:49.182320 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:49:49.184322 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:49:49.185676 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_concurrency.lockutils [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:49:49.186330 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO dbcounter [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Registered counter for database nova_cell0 May 26 17:49:49.187844 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_concurrency.lockutils [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:49:49.188724 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_concurrency.lockutils [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:49:49.190695 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_concurrency.lockutils [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115233) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:49:49.191168 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO dbcounter [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Registered counter for database nova_cell1 May 26 17:49:49.192760 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO dbcounter [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Registered counter for database nova_cell0 May 26 17:49:49.196817 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO dbcounter [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Registered counter for database nova_cell1 May 26 17:49:49.199483 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_db.sqlalchemy.engines [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.203765 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_db.sqlalchemy.engines [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.205887 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_db.sqlalchemy.engines [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.207968 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_db.sqlalchemy.engines [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.209627 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writer thread running {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.212266 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writer thread running {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.214939 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writer thread running {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.216184 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writer thread running {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.361892 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO dbcounter [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Registered counter for database nova_cell0 May 26 17:49:49.368305 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO dbcounter [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Registered counter for database nova_cell0 May 26 17:49:49.370839 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_db.sqlalchemy.engines [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.376182 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writer thread running {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.378153 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG oslo_db.sqlalchemy.engines [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:49:49.384101 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writer thread running {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:49:49.805825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: WARNING keystonemiddleware.auth_token [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:49:49.813463 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: WARNING keystonemiddleware.auth_token [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:49:49.959030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: WARNING keystonemiddleware.auth_token [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:49:49.966540 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: WARNING keystonemiddleware.auth_token [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:49:50.165297 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: WARNING keystonemiddleware.auth_token [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:49:50.172041 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: WARNING keystonemiddleware.auth_token [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:49:50.177454 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de0c3939c0 pid: 115234 (default app) May 26 17:49:50.179574 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:49:50.180775 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] 10.222.0.121 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001790 May 26 17:49:50.181184 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 1/1] 10.222.0.121 () {50 vars in 793 bytes} [Thu May 26 17:49:50 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:49:50.311866 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: WARNING keystonemiddleware.auth_token [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:49:50.318393 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: WARNING keystonemiddleware.auth_token [None req-38c4d86d-dc0b-4ef4-a9e9-cd01533cec9e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:49:50.323834 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de0c3939c0 pid: 115233 (default app) May 26 17:51:14.329152 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:14.330261 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001477 May 26 17:51:14.330686 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 2/2] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:14 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:14.347624 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_api:SELECT=3 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.349172 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_cell1:SELECT=3 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.350164 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_cell0:SELECT=3 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.351072 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:14.831333 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-c6520ac8-a9fa-4541-a36c-af250fecfae7 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:14.868063 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-c6520ac8-a9fa-4541-a36c-af250fecfae7 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.530279 May 26 17:51:14.868960 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 1/3] 10.222.0.121 () {60 vars in 1296 bytes} [Thu May 26 17:51:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:17.187603 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:17.188629 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-de02394e-dd24-444b-a891-3991ebe176b3 None None] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001525 May 26 17:51:17.189041 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 3/4] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:17 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:51:17.251563 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-65897798-508c-4b42-a1ac-1161238022a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "ram": 256}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:17.270427 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:51:17.270427 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: warnings.warn(msg) May 26 17:51:17.373765 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-65897798-508c-4b42-a1ac-1161238022a5 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.178519 May 26 17:51:17.374537 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 2/5] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:17.388707 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_api:SELECT=3 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.389524 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_cell0:SELECT=3 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.390699 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_cell1:SELECT=3 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.391754 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:51:17.602007 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a95c988e-d167-40b8-9020-9a2a290442d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:17.605074 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:51:17.605074 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:51:17.721308 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a95c988e-d167-40b8-9020-9a2a290442d2 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338822 May 26 17:51:17.722413 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 4/6] 10.222.0.121 () {64 vars in 1340 bytes} [Thu May 26 17:51:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:20.064631 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-65897798-508c-4b42-a1ac-1161238022a5 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:20.066227 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-65897798-508c-4b42-a1ac-1161238022a5 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002044 May 26 17:51:20.067099 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 3/7] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:20 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:20.196556 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-53dc9750-72aa-454a-a2f7-04224f20da16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "ram": 512}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:20.215270 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:51:20.215270 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:51:20.313274 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-53dc9750-72aa-454a-a2f7-04224f20da16 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.240151 May 26 17:51:20.313833 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 5/8] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:51:20.325589 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-cd90c674-c727-4075-954b-77d905165cfc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:20.327147 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:51:20.327147 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: warnings.warn(msg) May 26 17:51:20.424428 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-cd90c674-c727-4075-954b-77d905165cfc admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102550 May 26 17:51:20.425026 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 4/9] 10.222.0.121 () {64 vars in 1340 bytes} [Thu May 26 17:51:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:22.800668 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-53dc9750-72aa-454a-a2f7-04224f20da16 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:22.802111 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-53dc9750-72aa-454a-a2f7-04224f20da16 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 May 26 17:51:22.802373 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 6/10] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:22 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:22.867029 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-2fe7470d-b0b5-41a5-abb5-dc25fa3c0e8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:22.942854 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-2fe7470d-b0b5-41a5-abb5-dc25fa3c0e8d admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133244 May 26 17:51:22.943934 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 5/11] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:22.957412 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-0004a757-f080-4ac0-8ff5-b6cce7992011 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:23.065103 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-0004a757-f080-4ac0-8ff5-b6cce7992011 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111586 May 26 17:51:23.065858 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 7/12] 10.222.0.121 () {64 vars in 1340 bytes} [Thu May 26 17:51:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:25.454490 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-2fe7470d-b0b5-41a5-abb5-dc25fa3c0e8d admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:25.455556 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-2fe7470d-b0b5-41a5-abb5-dc25fa3c0e8d admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001527 May 26 17:51:25.456330 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 6/13] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:25 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:25.521349 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-1ba70e82-c4ce-4cd0-b2eb-c7243fef31f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "disk": 10, "swap": 0}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:25.592017 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-1ba70e82-c4ce-4cd0-b2eb-c7243fef31f0 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.129243 May 26 17:51:25.592635 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 8/14] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:25.605698 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-4d72809a-688b-4e9a-9f3b-b4fc6a248a40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:25.717459 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-4d72809a-688b-4e9a-9f3b-b4fc6a248a40 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116233 May 26 17:51:25.718053 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 7/15] 10.222.0.121 () {64 vars in 1340 bytes} [Thu May 26 17:51:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:28.066686 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-1ba70e82-c4ce-4cd0-b2eb-c7243fef31f0 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:28.067742 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-1ba70e82-c4ce-4cd0-b2eb-c7243fef31f0 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001522 May 26 17:51:28.070641 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 9/16] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:28 2022] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:51:28.138544 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:28.208388 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133220 May 26 17:51:28.209069 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 8/17] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:28.221621 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-dc3c72ba-1864-429a-b728-2634fec6af25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:28.312298 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-dc3c72ba-1864-429a-b728-2634fec6af25 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094177 May 26 17:51:28.312891 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 10/18] 10.222.0.121 () {64 vars in 1340 bytes} [Thu May 26 17:51:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:51:30.637653 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:30.639292 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002062 May 26 17:51:30.639875 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 9/19] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:30.711715 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-01cd2687-b97b-4f6a-b412-3211a26710d1 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:30.736410 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-01cd2687-b97b-4f6a-b412-3211a26710d1 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.090115 May 26 17:51:30.737169 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 11/20] 10.222.0.121 () {60 vars in 1296 bytes} [Thu May 26 17:51:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:51:33.096095 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:33.097629 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-161b3a09-43ce-4a5e-9129-329f0135b830 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002027 May 26 17:51:33.098184 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 10/21] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:33 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:33.158484 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a975b245-5a67-43f1-8b54-b479c8719591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:33.250515 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a975b245-5a67-43f1-8b54-b479c8719591 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146038 May 26 17:51:33.251207 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 12/22] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:33.265635 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-8d7853ef-8adb-49f2-9167-1ac5bcfe5a65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:33.333010 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-8d7853ef-8adb-49f2-9167-1ac5bcfe5a65 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073107 May 26 17:51:33.333604 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 11/23] 10.222.0.121 () {64 vars in 1337 bytes} [Thu May 26 17:51:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:35.809985 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a975b245-5a67-43f1-8b54-b479c8719591 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:35.811112 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a975b245-5a67-43f1-8b54-b479c8719591 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 May 26 17:51:35.811659 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 13/24] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:35 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:35.874583 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-3579afd9-8e39-4c6c-9b60-c6d2bbfe86fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "2", "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:36.026412 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-3579afd9-8e39-4c6c-9b60-c6d2bbfe86fc admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.208503 May 26 17:51:36.027198 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 12/25] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:36.039786 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-6b79677a-13f4-4df6-a41b-f74e59849aea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:36.194692 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-6b79677a-13f4-4df6-a41b-f74e59849aea admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158577 May 26 17:51:36.195324 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 14/26] 10.222.0.121 () {64 vars in 1337 bytes} [Thu May 26 17:51:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:38.657928 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-3579afd9-8e39-4c6c-9b60-c6d2bbfe86fc admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:38.659001 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-3579afd9-8e39-4c6c-9b60-c6d2bbfe86fc admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001501 May 26 17:51:38.659766 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 13/27] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:38 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:38.728327 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-3e3def33-417f-48e0-8ec2-3e397b03ee1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:38.864809 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-3e3def33-417f-48e0-8ec2-3e397b03ee1d admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.198428 May 26 17:51:38.865300 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 15/28] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:51:38.881232 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-babb3e93-156f-4e64-810c-59913338fbd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:38.949986 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-babb3e93-156f-4e64-810c-59913338fbd1 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074867 May 26 17:51:38.950619 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 14/29] 10.222.0.121 () {64 vars in 1337 bytes} [Thu May 26 17:51:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:51:41.282368 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-3e3def33-417f-48e0-8ec2-3e397b03ee1d admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:41.283418 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-3e3def33-417f-48e0-8ec2-3e397b03ee1d admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001485 May 26 17:51:41.283858 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 16/30] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:41.347255 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-7d08938a-b123-4605-8de1-5b09df6ca7b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:41.420101 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-7d08938a-b123-4605-8de1-5b09df6ca7b0 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.129510 May 26 17:51:41.421653 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 15/31] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:51:41.434348 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-10789c4a-2827-4d34-a73c-b45838c21ca5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:41.520400 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-10789c4a-2827-4d34-a73c-b45838c21ca5 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090980 May 26 17:51:41.520912 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 17/32] 10.222.0.121 () {64 vars in 1337 bytes} [Thu May 26 17:51:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:51:43.877370 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-7d08938a-b123-4605-8de1-5b09df6ca7b0 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:51:43.878427 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-7d08938a-b123-4605-8de1-5b09df6ca7b0 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001502 May 26 17:51:43.878854 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 16/33] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:51:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:51:43.951971 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "vcpus": 8, "disk": 160}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:44.161932 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.276228 May 26 17:51:44.162486 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 18/34] 10.222.0.121 () {64 vars in 1287 bytes} [Thu May 26 17:51:43 2022] POST /compute/v2.1/flavors => generated 410 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:51:44.175285 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-45a690c1-565e-44d1-b0ae-9b888e13e9a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:51:44.268283 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-45a690c1-565e-44d1-b0ae-9b888e13e9a4 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097308 May 26 17:51:44.269219 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 17/35] 10.222.0.121 () {64 vars in 1337 bytes} [Thu May 26 17:51:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:52:10.169370 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:10.170384 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001666 May 26 17:52:10.170790 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 19/36] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:52:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:10.182786 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:10.242308 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-6c73391a-f320-4c60-907e-eb7183192da7 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:10.261070 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-6c73391a-f320-4c60-907e-eb7183192da7 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.083536 May 26 17:52:10.261634 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 18/37] 10.222.0.121 () {60 vars in 1296 bytes} [Thu May 26 17:52:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:52:11.310152 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:11.311212 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-a41e6463-98c3-4349-b9ed-2e5e4be1d75e admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001437 May 26 17:52:11.311623 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 20/38] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:11 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:11.533405 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-d6bc70eb-00b9-49b6-9266-e751c2ce6ba5 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:11.539556 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.wsgi [None req-d6bc70eb-00b9-49b6-9266-e751c2ce6ba5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-d6bc70eb-00b9-49b6-9266-e751c2ce6ba5 admin admin] Request method failure captured: May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept: application/json May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept-Encoding: gzip, deflate May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Connection: keep-alive May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Content-Length: 0 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Host: 10.222.0.121 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-Api-Version: compute 2.90 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-System-Scope: None May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: User-Agent: python-novaclient May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Auth-Token: gAAAAABij75LnSfL5B7fm0rqExTDY3AUSa3zfVeoJxTDJiLieAmwqpme_DCc57Rnr17X_17sBdQz3KzrdhBkMHsjvXdfNuLeCtFA8Iz7wTl8amTmN39KK3uUr5qNWghKRvs8h6E-7FkoVwQzYzpvrsx7-3LpcqbDO-jEmVoL7eU32mT6IG_bIgY May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Id: None May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Name: None May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Identity-Status: Confirmed May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Is-Admin-Project: True May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Id: default May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Name: Default May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Name: admin May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Role: admin,member,reader May 26 17:52:11.542993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Roles: admin,member,reader May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant: admin May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Name: admin May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User: admin May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Id: default May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Name: Default May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Name: admin May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: method: > May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: exception: Flavor 42 could not be found. May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: action_args: {'id': '42'} May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:11.544699 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:11.545843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:11.547431 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-d6bc70eb-00b9-49b6-9266-e751c2ce6ba5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:11.548820 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-d6bc70eb-00b9-49b6-9266-e751c2ce6ba5 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069252 May 26 17:52:11.548820 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 19/39] 10.222.0.121 () {60 vars in 1195 bytes} [Thu May 26 17:52:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:52:11.554648 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-d5570cc3-fbfc-4230-83c0-b83bbb1c3a26 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:11.557735 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:52:11.578260 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-d5570cc3-fbfc-4230-83c0-b83bbb1c3a26 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027491 May 26 17:52:11.578852 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 21/40] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:11.591020 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-948b299c-bba1-4676-aa12-57e8666efb18 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:11.612611 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-948b299c-bba1-4676-aa12-57e8666efb18 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.025082 May 26 17:52:11.613182 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 20/41] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:11.624744 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-4843da1b-dd42-4eee-b4b0-dc75a7069a07 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:11.632654 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.wsgi [None req-4843da1b-dd42-4eee-b4b0-dc75a7069a07 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-4843da1b-dd42-4eee-b4b0-dc75a7069a07 admin admin] Request method failure captured: May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept: application/json May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept-Encoding: gzip, deflate May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Connection: keep-alive May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Content-Length: 0 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Host: 10.222.0.121 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-Api-Version: compute 2.90 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-System-Scope: None May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: User-Agent: python-novaclient May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Auth-Token: gAAAAABij75LnSfL5B7fm0rqExTDY3AUSa3zfVeoJxTDJiLieAmwqpme_DCc57Rnr17X_17sBdQz3KzrdhBkMHsjvXdfNuLeCtFA8Iz7wTl8amTmN39KK3uUr5qNWghKRvs8h6E-7FkoVwQzYzpvrsx7-3LpcqbDO-jEmVoL7eU32mT6IG_bIgY May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Id: None May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Name: None May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Identity-Status: Confirmed May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Is-Admin-Project: True May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Id: default May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Name: Default May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Name: admin May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Role: admin,member,reader May 26 17:52:11.636385 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Roles: admin,member,reader May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant: admin May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Name: admin May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User: admin May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Id: default May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Name: Default May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Name: admin May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: method: > May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: exception: Flavor 42 could not be found. May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: action_args: {'id': '42'} May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:11.638725 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:11.649952 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:11.652302 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-4843da1b-dd42-4eee-b4b0-dc75a7069a07 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:11.654649 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-4843da1b-dd42-4eee-b4b0-dc75a7069a07 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018710 May 26 17:52:11.654649 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 22/42] 10.222.0.121 () {60 vars in 1195 bytes} [Thu May 26 17:52:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:52:12.535312 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-948b299c-bba1-4676-aa12-57e8666efb18 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:12.536317 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-948b299c-bba1-4676-aa12-57e8666efb18 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001483 May 26 17:52:12.536714 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 21/43] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:12.733792 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-5604cde7-70e7-4047-974e-c1389ec21bcb admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:12.741207 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.wsgi [None req-5604cde7-70e7-4047-974e-c1389ec21bcb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-5604cde7-70e7-4047-974e-c1389ec21bcb admin admin] Request method failure captured: May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept: application/json May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept-Encoding: gzip, deflate May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Connection: keep-alive May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Content-Length: 0 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Host: 10.222.0.121 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-Api-Version: compute 2.90 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-System-Scope: None May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: User-Agent: python-novaclient May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Auth-Token: gAAAAABij75MCg_9IC-GJxpxbE-A-tQ809ph3I2CPARCQ3774SzwTUd7aDVBVhaCLyWgvFXnLieGsnJUUgehD5tfVK-rh7uID8FmJ3uPoD6Z7p3YCMmLzt9f0gPMQIMU50qEb1HC1XvCcAeFgx8jx69NAB623W51wgjFc3coWzoFrMvvVMIngZ8 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Id: None May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Name: None May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Identity-Status: Confirmed May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Is-Admin-Project: True May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Id: default May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Name: Default May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Name: admin May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Role: admin,member,reader May 26 17:52:12.742805 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Roles: admin,member,reader May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant: admin May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Name: admin May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User: admin May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Id: default May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Name: Default May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Name: admin May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: method: > May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: exception: Flavor 84 could not be found. May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: action_args: {'id': '84'} May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:12.744551 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:12.745535 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:12.747030 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-5604cde7-70e7-4047-974e-c1389ec21bcb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:12.748292 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-5604cde7-70e7-4047-974e-c1389ec21bcb admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067458 May 26 17:52:12.748292 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 23/44] 10.222.0.121 () {60 vars in 1195 bytes} [Thu May 26 17:52:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 17:52:12.754439 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-d2e4bb4f-ee02-47ac-a348-309b54f3e90c admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:12.770032 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-d2e4bb4f-ee02-47ac-a348-309b54f3e90c admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019079 May 26 17:52:12.770597 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 22/45] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:12.782802 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-bbb734c5-b4ae-43f9-91ae-4c76b2430526 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:12.797846 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-bbb734c5-b4ae-43f9-91ae-4c76b2430526 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.020107 May 26 17:52:12.798399 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 24/46] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:12.807887 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-7cd90270-c6ad-44f2-9eb9-122565db1105 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:12.813299 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.wsgi [None req-7cd90270-c6ad-44f2-9eb9-122565db1105 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-7cd90270-c6ad-44f2-9eb9-122565db1105 admin admin] Request method failure captured: May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept: application/json May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept-Encoding: gzip, deflate May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Connection: keep-alive May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Content-Length: 0 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Host: 10.222.0.121 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-Api-Version: compute 2.90 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-System-Scope: None May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: User-Agent: python-novaclient May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Auth-Token: gAAAAABij75MCg_9IC-GJxpxbE-A-tQ809ph3I2CPARCQ3774SzwTUd7aDVBVhaCLyWgvFXnLieGsnJUUgehD5tfVK-rh7uID8FmJ3uPoD6Z7p3YCMmLzt9f0gPMQIMU50qEb1HC1XvCcAeFgx8jx69NAB623W51wgjFc3coWzoFrMvvVMIngZ8 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Id: None May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Name: None May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Identity-Status: Confirmed May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Is-Admin-Project: True May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Id: default May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Name: Default May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Name: admin May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Role: admin,member,reader May 26 17:52:12.814843 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Roles: admin,member,reader May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant: admin May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Name: admin May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User: admin May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Id: default May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Name: Default May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Name: admin May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: method: > May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: exception: Flavor 84 could not be found. May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: action_args: {'id': '84'} May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:12.816442 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:12.817683 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:12.819016 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-7cd90270-c6ad-44f2-9eb9-122565db1105 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:12.820696 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-7cd90270-c6ad-44f2-9eb9-122565db1105 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011917 May 26 17:52:12.820931 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 23/47] 10.222.0.121 () {60 vars in 1195 bytes} [Thu May 26 17:52:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:52:13.714850 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-bbb734c5-b4ae-43f9-91ae-4c76b2430526 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:13.715876 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-bbb734c5-b4ae-43f9-91ae-4c76b2430526 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001464 May 26 17:52:13.716263 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 25/48] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:13.915669 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-15dea5db-9743-4bd6-926c-1d6c5688c51c admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:13.926507 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.wsgi [None req-15dea5db-9743-4bd6-926c-1d6c5688c51c admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-15dea5db-9743-4bd6-926c-1d6c5688c51c admin admin] Request method failure captured: May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept: application/json May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Accept-Encoding: gzip, deflate May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Connection: keep-alive May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Content-Length: 0 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Host: 10.222.0.121 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-Api-Version: compute 2.90 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Openstack-System-Scope: None May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: User-Agent: python-novaclient May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Auth-Token: gAAAAABij75N3q2cuhpd8uWoVSvUOSUIeIDpEacoLaRpuqaRHe0mZLf8bw7CPTy9qsnghRZ7af_pux41kInRraurZiZmtfyvidMBAR3dmbU6XrBOzOyBxFlddAJ8mkbE4BQhqLSb09QEF8pMv9eSNimf6LSk8maL0R-xuewZgpDnvso3qE55bSo May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Id: None May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Domain-Name: None May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Identity-Status: Confirmed May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Is-Admin-Project: True May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Id: default May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Domain-Name: Default May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Project-Name: admin May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Role: admin,member,reader May 26 17:52:13.928030 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Roles: admin,member,reader May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant: admin May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-Tenant-Name: admin May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User: admin May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Id: default May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Domain-Name: Default May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: X-User-Name: admin May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: method: > May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: exception: Flavor 451 could not be found. May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: action_args: {'id': '451'} May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:13.929774 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:13.930594 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: ERROR nova.api.openstack.wsgi May 26 17:52:13.931942 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-15dea5db-9743-4bd6-926c-1d6c5688c51c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115233) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:13.933179 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-15dea5db-9743-4bd6-926c-1d6c5688c51c admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075148 May 26 17:52:13.933179 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 24/49] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:52:13.939971 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-eac970e7-1934-4721-8e68-1435e00c14d0 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:13.955006 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-eac970e7-1934-4721-8e68-1435e00c14d0 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018491 May 26 17:52:13.955538 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 26/50] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:13.966167 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:13.980007 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017396 May 26 17:52:13.980569 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 25/51] 10.222.0.121 () {60 vars in 1215 bytes} [Thu May 26 17:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:52:13.990558 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-67de58b5-bb47-4eca-aa01-bd061951fd18 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:13.996368 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.wsgi [None req-67de58b5-bb47-4eca-aa01-bd061951fd18 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-67de58b5-bb47-4eca-aa01-bd061951fd18 admin admin] Request method failure captured: May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept: application/json May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Accept-Encoding: gzip, deflate May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Connection: keep-alive May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Content-Length: 0 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Host: 10.222.0.121 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-Api-Version: compute 2.90 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Openstack-System-Scope: None May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: User-Agent: python-novaclient May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Auth-Token: gAAAAABij75N3q2cuhpd8uWoVSvUOSUIeIDpEacoLaRpuqaRHe0mZLf8bw7CPTy9qsnghRZ7af_pux41kInRraurZiZmtfyvidMBAR3dmbU6XrBOzOyBxFlddAJ8mkbE4BQhqLSb09QEF8pMv9eSNimf6LSk8maL0R-xuewZgpDnvso3qE55bSo May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Id: None May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Domain-Name: None May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Identity-Status: Confirmed May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Is-Admin-Project: True May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Openstack-Nova-Api-Version: 2.90 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Id: default May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Domain-Name: Default May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Project-Name: admin May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Role: admin,member,reader May 26 17:52:13.997883 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Roles: admin,member,reader May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a01a22dec10b499785fdfbdf0a6fcb47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a01a22dec10b499785fdfbdf0a6fcb47", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant: admin May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Id: a01a22dec10b499785fdfbdf0a6fcb47 May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-Tenant-Name: admin May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User: admin May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Id: default May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Domain-Name: Default May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Id: 9845c1dd09f34a0aa117c5e212e20304 May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: X-User-Name: admin May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: method: > May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: exception: Flavor 451 could not be found. May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: action_args: {'id': '451'} May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:52:13.999504 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:14.000501 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: ERROR nova.api.openstack.wsgi May 26 17:52:14.001825 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-67de58b5-bb47-4eca-aa01-bd061951fd18 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115234) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:52:14.003095 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-67de58b5-bb47-4eca-aa01-bd061951fd18 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012708 May 26 17:52:14.003095 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 27/52] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 17:52:14.900463 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:14.900463 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001599 May 26 17:52:14.900463 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 26/53] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:14 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:15.097273 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-d1e79cac-f01a-4f30-af7d-7e6e4b844294 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:52:15.178003 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-d1e79cac-f01a-4f30-af7d-7e6e4b844294 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.135146 May 26 17:52:15.178566 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 28/54] 10.222.0.121 () {64 vars in 1240 bytes} [Thu May 26 17:52:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:52:16.067245 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:16.071202 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001669 May 26 17:52:16.071202 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 27/55] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:16 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:16.274026 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-7459983c-7dc2-4d3f-88f4-5bdd1b67bc31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:52:16.349689 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-7459983c-7dc2-4d3f-88f4-5bdd1b67bc31 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.141629 May 26 17:52:16.350240 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 29/56] 10.222.0.121 () {64 vars in 1240 bytes} [Thu May 26 17:52:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:52:17.260785 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:17.262426 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002310 May 26 17:52:17.263186 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 28/57] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:17 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:17.466319 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-c83f1827-b7e6-4ec0-bf9a-10dbf72d6c51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:52:17.539788 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-c83f1827-b7e6-4ec0-bf9a-10dbf72d6c51 admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.135570 May 26 17:52:17.540267 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 30/58] 10.222.0.121 () {64 vars in 1240 bytes} [Thu May 26 17:52:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:52:18.485428 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:18.486486 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001503 May 26 17:52:18.486919 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 29/59] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:18 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:52:18.690465 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-aa927cf5-ddca-4139-92f2-6e4a8e98a48e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:52:18.755125 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-aa927cf5-ddca-4139-92f2-6e4a8e98a48e admin admin] 10.222.0.121 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.119329 May 26 17:52:18.755672 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 31/60] 10.222.0.121 () {64 vars in 1240 bytes} [Thu May 26 17:52:18 2022] POST /compute/v2.1/flavors => generated 411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:52:19.639799 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:19.640753 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 May 26 17:52:19.641147 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 30/61] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:52:19 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:52:19.835589 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-f1e4ec82-e24a-4bcf-9e75-4cb25c412d14 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:52:19.856876 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-f1e4ec82-e24a-4bcf-9e75-4cb25c412d14 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.078229 May 26 17:52:19.857245 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 32/62] 10.222.0.121 () {60 vars in 1207 bytes} [Thu May 26 17:52:19 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:53:23.615611 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.616993 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-232a736c-072b-42bf-a61e-b99a0d556192 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001865 May 26 17:53:23.617500 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 31/63] 10.222.0.121 () {54 vars in 935 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:53:23.625193 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:23.680346 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-51f3010e-f335-4842-b3ea-e6f963f09625 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.700317 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-51f3010e-f335-4842-b3ea-e6f963f09625 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.076584 May 26 17:53:23.700864 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 33/64] 10.222.0.121 () {60 vars in 1296 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:53:23.722928 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG dbcounter [-] [115233] Writing DB stats nova_api:SELECT=14 {{(pid=115233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:53:23.726881 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-a1bb1b0d-76f4-4e1b-9e44-82b721458e30 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.734493 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-a1bb1b0d-76f4-4e1b-9e44-82b721458e30 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013018 May 26 17:53:23.735472 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 32/65] 10.222.0.121 () {60 vars in 1287 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:23.748052 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-d5c41190-c93e-4e35-8d01-faca4080866c admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.758377 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-d5c41190-c93e-4e35-8d01-faca4080866c admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014165 May 26 17:53:23.758957 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 34/66] 10.222.0.121 () {60 vars in 1290 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:53:23.770716 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.779264 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012252 May 26 17:53:23.779808 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 33/67] 10.222.0.121 () {60 vars in 1290 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:53:23.792791 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-9448e878-6c28-4ed2-8f99-08ca99b7349b admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:53:23.800623 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-9448e878-6c28-4ed2-8f99-08ca99b7349b admin admin] 10.222.0.121 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011347 May 26 17:53:23.801571 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 35/68] 10.222.0.121 () {60 vars in 1287 bytes} [Thu May 26 17:53:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:57:30.891231 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:30.892254 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001521 May 26 17:57:30.892658 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 34/69] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:57:30 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:31.053462 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_api:SELECT=6 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:31.180544 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:31.181869 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:31.181869 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:57:31.183198 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:31.183688 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:31.184483 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:31.184914 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:31.222718 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-d567fabd-23e9-4742-9ae7-8aef4c670bbb admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.171425 May 26 17:57:31.223860 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 36/70] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:57:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:32.122181 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:32.123241 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001468 May 26 17:57:32.123650 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 35/71] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:57:32 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:57:32.325362 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:32.326506 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:32.326506 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:57:32.327772 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:32.328214 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:32.328991 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:32.329414 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:32.349229 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-7d9172e8-fdeb-424e-8699-ac2853f45fed admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079587 May 26 17:57:32.349714 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 37/72] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:57:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 17:57:43.671108 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:43.672151 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001509 May 26 17:57:43.672545 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 36/73] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:57:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:57:43.819470 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_cell0:SELECT=4 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:43.820109 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_cell1:SELECT=4 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:43.820750 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG dbcounter [-] [115234] Writing DB stats nova_api:SELECT=8 {{(pid=115234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:57:43.877633 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:43.879379 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:43.879379 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:57:43.880753 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:43.881399 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:43.882057 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:43.882492 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:43.909334 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-0ad05320-8af2-437b-aed8-d8c383147e25 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095487 May 26 17:57:43.909922 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 38/74] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:57:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:57:44.836613 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: DEBUG nova.api.openstack.wsgi [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] Calling method '>' {{(pid=115233) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:44.837613 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: INFO nova.api.openstack.requestlog [None req-10a265f3-43ce-46b5-b30b-f86664ff7df6 admin admin] 10.222.0.121 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001429 May 26 17:57:44.842187 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: [pid: 115233|app: 0|req: 37/75] 10.222.0.121 () {56 vars in 1079 bytes} [Thu May 26 17:57:44 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:57:45.035517 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG nova.api.openstack.wsgi [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] Calling method '>' {{(pid=115234) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:57:45.036708 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 17:57:45.036708 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: warnings.warn(msg) May 26 17:57:45.037916 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:45.038388 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:45.039199 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:57:45.039657 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: DEBUG oslo_concurrency.lockutils [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115234) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:57:45.062112 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: INFO nova.api.openstack.requestlog [None req-bc03fffe-8f67-4b5e-b4ca-52ef0b6fb716 admin admin] 10.222.0.121 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081968 May 26 17:57:45.062672 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: [pid: 115234|app: 0|req: 39/76] 10.222.0.121 () {60 vars in 1198 bytes} [Thu May 26 17:57:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:58:43.182430 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: Thu May 26 17:58:43 2022 - graceful shutdown triggered... May 26 17:58:43.183261 dv-cinder-836073-5-iscsi devstack@n-api.service[115233]: Gracefully killing worker 1 (pid: 115233)... May 26 17:58:43.183823 dv-cinder-836073-5-iscsi devstack@n-api.service[115234]: Gracefully killing worker 2 (pid: 115234)... May 26 17:58:43.184897 dv-cinder-836073-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 17:58:44.183575 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: worker 1 buried after 1 seconds May 26 17:58:44.183575 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: worker 2 buried after 1 seconds May 26 17:58:44.183575 dv-cinder-836073-5-iscsi devstack@n-api.service[115232]: goodbye to uWSGI. May 26 17:58:44.185165 dv-cinder-836073-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 17:58:44.185824 dv-cinder-836073-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 17:58:44.189787 dv-cinder-836073-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 17:58:44.208806 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 17:58:44 2022] *** May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: nodename: dv-cinder-836073-5-iscsi May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: machine: x86_64 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: clock source: unix May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: pcre jit disabled May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: detected number of CPU cores: 4 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: current working directory: / May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: detected binary path: /usr/bin/uwsgi-core May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: your processes number limit is 47680 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: your memory page size is 4096 bytes May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: detected max file descriptor number: 2048 May 26 17:58:44.236746 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: lock engine: pthread robust mutexes May 26 17:58:44.237889 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: thunder lock: enabled May 26 17:58:44.237889 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 17:58:44.237889 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 17:58:44.284900 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: Python main interpreter initialized at 0x559b1cf409c0 May 26 17:58:44.284900 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: python threads support enabled May 26 17:58:44.284900 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: your server socket listen backlog is limited to 100 connections May 26 17:58:44.284900 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: your mercy for graceful operations on workers is 90 seconds May 26 17:58:44.285357 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: mapped 403077 bytes (393 KB) for 2 cores May 26 17:58:44.285357 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: *** Operational MODE: preforking *** May 26 17:58:44.285634 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: *** uWSGI is running in multiple interpreter mode *** May 26 17:58:44.285634 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: spawned uWSGI master process (pid: 130086) May 26 17:58:44.285855 dv-cinder-836073-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 17:58:44.291024 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: spawned uWSGI worker 1 (pid: 130099, cores: 1) May 26 17:58:44.291024 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: spawned uWSGI worker 2 (pid: 130100, cores: 1) May 26 17:58:44.291024 dv-cinder-836073-5-iscsi devstack@n-api.service[130086]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 17:58:45.506456 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:58:45.559788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 17:58:46.322670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:58:46.322670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: from cryptography.utils import int_from_bytes May 26 17:58:46.323455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:58:46.323455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: from cryptography.utils import int_from_bytes May 26 17:58:46.372397 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:58:46.372397 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: from cryptography.utils import int_from_bytes May 26 17:58:46.373017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 17:58:46.373017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: from cryptography.utils import int_from_bytes May 26 17:58:48.819980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:58:48.820630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:58:48.820923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:58:48.821133 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:58:48.821397 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:58:48.821784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.822112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.822436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.822760 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.823118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.823426 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.823755 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.824076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.824407 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.824671 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.824988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.825314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836073-5-iscsi {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.825639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.825948 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.826259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.826578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.826915 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.827243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.828300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.829550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.829550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.829830 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.831348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.831348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.831348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.831348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.832233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.832233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.832233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.832882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.832882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836073-5-iscsi {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.833298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.833524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.833830 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.834237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.834554 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.834891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.835200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.835568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.835822 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.836152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.836474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.836796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.837119 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.837428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.837739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.838145 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.838477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.838785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.839185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.839440 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.839751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.840076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.840404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.840729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.840982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.841231 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.841552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.841923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.842169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.842477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.842783 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.844009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.844269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.844546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.844715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.844969 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.845286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.845604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.845930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.846246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.846568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.847008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.847262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.847573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.847920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.848243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.848556 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.848880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.849203 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.849513 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.849821 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.850132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.850458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.850786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.851123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.851379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.851685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.851993 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.852315 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.852626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.852934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.853243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.853546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.853854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.854158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.854465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.854771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.855103 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.855409 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.855717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.856023 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.856329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.856649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.856983 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.857281 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.857585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.857942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.858276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.858691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.859057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.859371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.859713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.860004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.861161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.861161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.861161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.862977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.863151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.863332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.863637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.863941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.864358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.864549 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.864852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.865151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.865470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.865800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.866110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.866424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.866903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.867132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.867509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.867798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.868157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.868475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.868813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.869155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.869503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.869783 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.870101 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.870438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.870752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.871094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.871408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.871729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.872048 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.872380 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.872699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.873018 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.873337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.873650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.873970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.874879 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.875214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.875363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 17:58:48.875852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.876012 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 17:58:48.876108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.876201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 17:58:48.876318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.876499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.876604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 17:58:48.876824 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.876917 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 17:58:48.877156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.877347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.877503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.877752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.877896 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.878132 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.878292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.878443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.878543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.878778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.878886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.879119 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.879314 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.879442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.879650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.879807 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.880063 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.880177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.880359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.880644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.880749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.880943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.881035 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.881302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.881410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.881626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.881751 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836073-5-iscsi {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.881939 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.882040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.882252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.882341 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.882567 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.882668 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.882901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.883009 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.883214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.883307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.883525 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.883626 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.883831 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.883930 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.884137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.884343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.884457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.884659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.884757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.884969 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.885060 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.885286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.885377 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.885630 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.885732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.885943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.886038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.886255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.886355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.886570 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.886667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.886901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.887011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.887213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.887311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.887523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.887616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.887926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.888045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836073-5-iscsi {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.888232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.888322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.888550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.888693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.888855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.888946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.889179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.889269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.889491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.889581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.889902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.889999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.890235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.890327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.890541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.890646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.890925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.891035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.891179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.891283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.891492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.891598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.891806 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.891898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.892118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.892215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.892422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.892519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.892733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.892825 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.893047 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.893145 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.893358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.893461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.893664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.893759 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.893973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.894071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.894228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.894326 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.894536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.894633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.894880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.894988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.895205 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.895306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.895529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.895632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.895784 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.895883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.896036 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.896172 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.896360 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.896458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.896683 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.896789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.897249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.897386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.897556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.897656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.897970 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.898091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.898179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.898262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.898470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.898562 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.898779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.898979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.899112 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.899204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.899421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.899521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.899742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.899842 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.900046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.900137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.900351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.900452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.900674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.900762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.900994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.901083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.901335 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.901461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.121 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.901672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.901770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.121 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.901993 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.902127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.902318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.902734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.902734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.903026 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.903149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.903260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.903409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.903526 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.903736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.903868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.904048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.904165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.904358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.904475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.904669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.904799 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.904990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.905114 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.905309 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.906158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.906158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.906437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.906554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.906670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.906786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.906954 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.908223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.908372 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.908471 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.908565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.908650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.908732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.908874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.908874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.909076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.909206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.909303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.909388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.909479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.909572 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.909664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.909748 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.909844 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.909941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.910032 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.910115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.910197 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.910349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.910449 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.910659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.910751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.910999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.911178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.911357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.911517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.911626 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.911818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.912282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.912382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.912468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.912544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.912632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.912752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.912985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.913080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.913176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.913371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.913592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.913674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.913915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.914092 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.914227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.914319 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.914555 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.914645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.914890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.915000 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.915203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.915294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.915527 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.915618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.915839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.915940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.916148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.916238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.916458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.916547 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.916760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.916863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.917067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.917163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.917381 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.917512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.917690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.917804 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.918004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.918151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.918370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.918541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.918650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.918737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.918914 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.919074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.919226 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.919328 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.919533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.919626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.919840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.919941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.920141 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.920246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.920463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.920563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.920786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.920885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.921218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.921337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.921536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.921683 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.921849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.921998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.922267 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 17:58:48.922368 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.922615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.922715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.922950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923044 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923570 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.923976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924840 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.924932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925480 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925790 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.925893 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926422 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.926869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927397 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.927817 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928022 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.928954 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929340 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929864 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.929963 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930791 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.930964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.931131 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.931223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.931496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.931725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.931824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932060 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.932790 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.933984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934720 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.934954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935049 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.935953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.936262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.936575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.937385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.937545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.937814 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.938075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.938260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.938486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.938805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939471 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.939979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.940906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941527 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.941994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942601 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942771 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.942982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943624 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.943971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944832 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.944926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945079 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945079 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.945876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946007 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946859 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.946956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.947917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.948139 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.948238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.948454 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.948561 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.948786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949331 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.949970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.950068 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.950313 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.950632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.950804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.950994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951134 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951283 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.951904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.952139 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.952237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.952994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.953107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.953384 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.953465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.953718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.953885 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954324 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.954944 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.955314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.955577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.955681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.955892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.956029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.956201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.956363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.956532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.956976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.957865 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.958979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.959997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960320 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960828 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.960977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961624 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961743 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.961942 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.962899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963226 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963416 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.963919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964346 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.964966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965282 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.965903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.966879 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.967887 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.968977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969401 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.969918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.970968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971501 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971814 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.971906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972221 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.972853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973370 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973695 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.973787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974035 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974293 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974602 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.974929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.975996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976309 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.976926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977635 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.977954 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978272 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.978976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979086 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979471 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.979930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980540 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.980980 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981318 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981790 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.981910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982229 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982542 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.982890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.983078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.983195 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.983422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.983539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.983839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984031 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984265 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984760 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.984888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986080 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.986885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987129 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987297 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.987824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988129 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.988894 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.989970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990156 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990481 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.990958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.991154 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.991288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.991495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.991711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.991827 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992038 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992354 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992491 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992686 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.992809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993017 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.993943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994041 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994256 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994686 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.994916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995842 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.995945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.996863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997076 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997172 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.997854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998700 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.998800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.999036 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.999128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:48.999908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000211 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000426 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.000883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001049 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.001860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002011 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.002807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.003798 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004353 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.004963 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.005977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006626 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.006926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.007929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008209 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.008848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.009077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.009180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.009387 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.009488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.009736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010666 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.010998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011542 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.011968 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012283 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.012932 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.013852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014468 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.014784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.015669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.016001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.016318 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.016636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.016949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.017261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.017570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.017885 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.018194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.018503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.018812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019454 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019610 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.019974 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.020996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.021295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.021422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.021674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.021802 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.022233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.022396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.022560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.022685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023672 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023822 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.023972 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024593 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.024898 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025540 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.025923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.026247 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.026564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.026732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.026950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.027105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.027266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.027429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.027631 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.027849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028800 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.028959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029317 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.029943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.030090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.030248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.030406 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.031151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.031464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.031633 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.031794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.031944 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032256 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032556 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032717 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.032874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033836 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.033992 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.034141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.034297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.034447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.034610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.034791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.035118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.035287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.035479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.035646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.035941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.036257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.036411 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.036568 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.036870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037037 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037187 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037494 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.037801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.038091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.038260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.038515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.038681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.038855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.039159 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.039474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.039630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.039787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.039936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040393 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.040869 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041504 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041811 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.041961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042124 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042274 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042587 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.042947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043566 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043714 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.043945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044255 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.044931 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.045144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.045298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.045473 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.045636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.045785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.046198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.046515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.046673 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.046865 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.047191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.047510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.047686 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.047847 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048291 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048615 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.048924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.049073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.049229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.049379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.049536 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.049790 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.050118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.050433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.050759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.050998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051635 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.051950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.052099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.052309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.052464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.052625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.052866 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053082 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.053890 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054205 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054353 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.054839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.055937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.056085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.056332 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.056657 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.056820 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.056999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.057208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.057373 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.057576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.057731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.057888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058210 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.058925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.059870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060028 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060185 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060366 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.060873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.061031 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.061186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.061345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.061502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.061652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.062414 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.062579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.062737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.062989 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.063300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.063466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.063729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.063889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064687 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.064939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.065093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.065249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.065543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.065711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.065870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.066020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.066168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.066458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.066786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.067036 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.067194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.067419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.067581 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.067739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068190 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068838 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.068990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069307 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.069959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070170 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070646 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070795 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.070972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.071137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.071306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.071552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.071707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.071877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.072199 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.072364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.072521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.072821 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.072986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.073136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.073422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.073588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.073737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.074002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.074170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.074402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.074607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.074772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.075080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.075236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.075523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.075862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.076033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.076192 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.076473 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.077040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.077247 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.078531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.078809 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.079151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.079330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.079558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.079765 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.079928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.080201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.080388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.080762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.080933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.081104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.081423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.081600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.081876 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.082032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.082214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.082552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.082718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.082908 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.083182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.083350 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.083553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.083735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.083888 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084428 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084762 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.084911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085279 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085464 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085792 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.085980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.086146 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.086303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.086469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.086800 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087624 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.087948 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.088109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.088405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.088560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.088718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.088883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089825 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.089975 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090125 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090446 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090765 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.090949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.091290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.091580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.091908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.092239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.092562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.092886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.093826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.094156 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.094505 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.098869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099353 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.099920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100053 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100132 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100453 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100526 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.100989 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101231 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101790 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.101955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102029 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102102 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102260 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.102734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.103315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.103315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.103623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.103934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.104251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.104567 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.104880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.105196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.105505 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.105838 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.106152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.106462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.106771 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.107116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.107429 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.107742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.108065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.108370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.108791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.109091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.109345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.109581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.109971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.110134 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.110278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.110410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.110575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111783 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.111925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.112249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.112402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.112535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.114940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.115097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.115292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.115462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.115638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.115846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116017 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.116175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117525 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.117687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.118193 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.118570 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.118570 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.118919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.119101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.119568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.119741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.119912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.120124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.120299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.120466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.120808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.120968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.121197 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.121364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.121749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.122007 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.122206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.122396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.122783 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123051 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123436 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.123903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.124739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.124915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.124915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.125404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.125667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.125667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126022 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.126872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127051 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:58:49.127379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.127379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.128124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.128124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.128124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.128577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.128731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.129017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.129643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.129828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.129993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.130403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.130919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.131091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.131417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.131878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.132049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.132382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.132735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.133049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.133357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.133682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.134032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.134370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.134705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.135141 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.135459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.135774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.136093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.136422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.136744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.137057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.137368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.137684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.137996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.138309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.138622 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.139489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.139489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.140720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.140720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.140720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.141704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.141704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.142289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.142458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.142644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.142996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.143305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.143608 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.143919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.144266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.144609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.144931 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.146281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.146281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.146281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.146281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.147208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.147208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.147524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.147701 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.148040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.148359 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.148678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.148995 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.149313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.149629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.150151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.150324 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.150594 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.150927 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.151308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.151581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.151909 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.152232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.152550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.152895 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.153211 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.153506 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.153827 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.154146 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.154463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.154786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.155134 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.155496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.155834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.156161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.156629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.156982 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.157342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.157662 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.158013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.158353 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.158678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.159041 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.159357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 17:58:49.159609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 17:58:49.191742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO dbcounter [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Registered counter for database nova_api May 26 17:58:49.214105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.222172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO dbcounter [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Registered counter for database nova_api May 26 17:58:49.223088 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writer thread running {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.243641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_db.sqlalchemy.engines [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.252028 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writer thread running {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.283500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.context [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aa3fa86-c8c9-4c3d-99e8-137d16582b2d(cell1) {{(pid=130100) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:58:49.286964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:58:49.288553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:58:49.289428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:58:49.291447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:58:49.293437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO dbcounter [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Registered counter for database nova_cell0 May 26 17:58:49.298318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO dbcounter [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Registered counter for database nova_cell1 May 26 17:58:49.306227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.307152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.309666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.context [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1aa3fa86-c8c9-4c3d-99e8-137d16582b2d(cell1) {{(pid=130099) load_cells /opt/stack/nova/nova/context.py:464}} May 26 17:58:49.314468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:58:49.314626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writer thread running {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.315902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writer thread running {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.316094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:58:49.317916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:58:49.318892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:58:49.320979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO dbcounter [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Registered counter for database nova_cell0 May 26 17:58:49.325024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO dbcounter [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Registered counter for database nova_cell1 May 26 17:58:49.332868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_db.sqlalchemy.engines [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.334203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_db.sqlalchemy.engines [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.340904 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writer thread running {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.342191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writer thread running {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.468101 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO dbcounter [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Registered counter for database nova_cell0 May 26 17:58:49.474970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_db.sqlalchemy.engines [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.480356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writer thread running {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.492877 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO dbcounter [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Registered counter for database nova_cell0 May 26 17:58:49.501904 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_db.sqlalchemy.engines [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 17:58:49.506482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writer thread running {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 17:58:49.819667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: WARNING keystonemiddleware.auth_token [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:58:49.828688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: WARNING keystonemiddleware.auth_token [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:58:49.840861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: WARNING keystonemiddleware.auth_token [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:58:49.848986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: WARNING keystonemiddleware.auth_token [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:58:50.200000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: WARNING keystonemiddleware.auth_token [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:58:50.206765 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: WARNING keystonemiddleware.auth_token [None req-eed78fc5-108b-4597-a1c9-615284bbdedb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:58:50.212530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b1cf409c0 pid: 130099 (default app) May 26 17:58:50.213586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: WARNING keystonemiddleware.auth_token [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 17:58:50.220342 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: WARNING keystonemiddleware.auth_token [None req-b4cd85c9-4b82-4031-ad58-19eea3626f32 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 17:58:50.226076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559b1cf409c0 pid: 130100 (default app) May 26 17:59:34.243385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:34.244372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:34.245522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:34.246273 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:36.024453 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e3ca347d-578a-4a31-95be-7cfc75a83ae2 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Action: 'create', calling method: .version_select at 0x7f4b8b7ffc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1913377782"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:38.361835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e3ca347d-578a-4a31-95be-7cfc75a83ae2 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.123306 May 26 17:59:38.362625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 1/1] 10.222.0.121 () {60 vars in 1159 bytes} [Thu May 26 17:59:34 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4126 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) May 26 17:59:38.836896 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3736e4f6-86cf-45d4-a1e6-6bbdbd847eca tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8b843670>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:38.869810 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:38.870814 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:38.871884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:38.872779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:39.140563 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2123702185", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "networks": [{"uuid": "4ad763fb-bf65-477d-969d-06d0733c6355"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:39.401381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] validate_networks() for [('4ad763fb-bf65-477d-969d-06d0733c6355', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:59:39.828939 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3736e4f6-86cf-45d4-a1e6-6bbdbd847eca tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 200 len: 345 microversion: 2.1 time: 1.455281 May 26 17:59:39.830500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 1/2] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 17:59:38 2022] GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 345 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:40.845747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-05e3702a-c19d-476c-8fef-890b4f08cf02 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8b689820>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:41.077742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-05e3702a-c19d-476c-8fef-890b4f08cf02 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 200 len: 346 microversion: 2.1 time: 0.238400 May 26 17:59:41.078661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 2/3] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 17:59:40 2022] GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 346 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:41.094713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8c48dd5c-7d7c-4be1-8c99-9cec0b4cf8ea tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Action: 'create', calling method: .version_select at 0x7f4b8b689e50>, body: {"snapshot": {"volume_id": "2e313be4-2d81-4802-956f-386a95e33000", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1430141320"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:41.816167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8c48dd5c-7d7c-4be1-8c99-9cec0b4cf8ea tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.724717 May 26 17:59:41.817319 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 3/4] 10.222.0.121 () {60 vars in 1166 bytes} [Thu May 26 17:59:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:41.827694 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-31c3d281-854b-4624-8a3e-8a22f9e00b3c tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8b6548b0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:41.999679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-31c3d281-854b-4624-8a3e-8a22f9e00b3c tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.176366 May 26 17:59:42.000708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 4/5] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:41 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:42.010020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-61fac4b4-6a8d-43ab-adc8-87d004b431d3 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8b689b80>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:42.130849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-61fac4b4-6a8d-43ab-adc8-87d004b431d3 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.124511 May 26 17:59:42.131421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 5/6] 10.222.0.121 () {58 vars in 1144 bytes} [Thu May 26 17:59:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:42.142957 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8aefe53d-9aa1-41a2-bc51-072072a5061a tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8b654430>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:42.246708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8aefe53d-9aa1-41a2-bc51-072072a5061a tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.108599 May 26 17:59:42.247669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 6/7] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:42 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:42.285497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:59:42.286040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:59:42.286724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:59:42.287431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:59:42.288094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:59:42.319849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:42.320699 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:42.321750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:42.324151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:42.399439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Getting quotas for project d338e1d056d94062a703aa03ecb7edbb. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:59:42.415115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Getting quotas for user 84b4d6be32e94ccd80f97aa8c93efbcc and project d338e1d056d94062a703aa03ecb7edbb. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:59:42.456658 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:59:42.462189 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:59:42.701864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ecca7069-9b28-4a40-ab91-07a10eb21278 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.832196 May 26 17:59:42.703490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 2/8] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 17:59:38 2022] POST /compute/v2.1/servers => generated 382 bytes in 3835 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:59:42.717339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-da21037f-1247-4cb1-ae5e-a2192219bdd9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:42.717339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-da21037f-1247-4cb1-ae5e-a2192219bdd9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:43.041078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-da21037f-1247-4cb1-ae5e-a2192219bdd9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:43.074436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-da21037f-1247-4cb1-ae5e-a2192219bdd9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1219 microversion: 2.1 time: 0.363016 May 26 17:59:43.076057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 7/9] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:42 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1219 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:43.282264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3322f3ae-4013-4e14-9034-cc3c12ce78ce tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8ad67700>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:43.370874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3322f3ae-4013-4e14-9034-cc3c12ce78ce tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.113183 May 26 17:59:43.371614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 3/10] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:43 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:44.093916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f435d265-9e67-4296-afeb-0dec56fe5df1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:44.094641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f435d265-9e67-4296-afeb-0dec56fe5df1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:44.362109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f435d265-9e67-4296-afeb-0dec56fe5df1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:44.372400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f435d265-9e67-4296-afeb-0dec56fe5df1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1219 microversion: 2.1 time: 0.283510 May 26 17:59:44.374576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 8/11] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:44 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1219 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:44.384663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ad062f24-947f-4ad7-8a01-dba5963805b7 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8ad67e50>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:44.447701 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ad062f24-947f-4ad7-8a01-dba5963805b7 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.067066 May 26 17:59:44.448700 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 4/12] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:44 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:45.396081 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a56b4bf6-c754-4884-bd6e-df117425947f tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:45.396692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a56b4bf6-c754-4884-bd6e-df117425947f tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:45.460437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-babb5ea1-6b5c-4807-972d-1ace8f8264bf tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8ad67d30>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:45.499207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-babb5ea1-6b5c-4807-972d-1ace8f8264bf tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.042749 May 26 17:59:45.499749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 5/13] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:45 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:45.527619 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a56b4bf6-c754-4884-bd6e-df117425947f tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:45.545622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a56b4bf6-c754-4884-bd6e-df117425947f tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1219 microversion: 2.1 time: 0.154275 May 26 17:59:45.565138 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 9/14] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:45 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:46.510965 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fc766691-9e34-4e19-96b6-5b7a934abf81 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8ad67670>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:46.561869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fc766691-9e34-4e19-96b6-5b7a934abf81 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.054564 May 26 17:59:46.562853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 6/15] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:46 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:46.589333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:46.589905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:46.598295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:46.598724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:46.599528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:46.599955 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:46.953855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:46.975997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d0596647-3357-4368-9227-56de9f47f86e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1223 microversion: 2.1 time: 0.392452 May 26 17:59:46.982565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 10/16] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:46 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1223 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:47.573855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-32fcb741-2d73-4a4d-b75f-cb93d0e1f937 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a507280>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:47.677065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-32fcb741-2d73-4a4d-b75f-cb93d0e1f937 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.105904 May 26 17:59:47.677065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 7/17] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:47 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:48.005409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:48.006191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:48.082130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:48.082757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:48.086068 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:48.089911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:48.291563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-415423201", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:48.529788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] validate_networks() for [('8c20ae16-163c-4137-8a9f-95e057614528', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:59:48.736684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:48.760878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-88937d42-30dc-448d-81ff-fcac70d94df9 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1215 microversion: 2.1 time: 0.764238 May 26 17:59:48.762408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 8/18] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:47 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1215 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:59:49.255862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-53bfd495-4ad4-4a6f-9abb-9a2a79bae17e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: .version_select at 0x7f4b8a4f6ca0>, body: {"keypair": {"name": "tempest-keypair-1203171491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNGQMfyL44qmGnHr9gbDtZ/x2Jx3hJU6QFzFNzJJ6CP0pEk4uAOYwsiU62Ydui3KjMPeZpkcKoRZizZc5F9cAVir+j+r2KZCuiQo+9eCmesgScvehYNX3dcTEjw10MJyg=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:49.340861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-53bfd495-4ad4-4a6f-9abb-9a2a79bae17e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:59:49.362438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-53bfd495-4ad4-4a6f-9abb-9a2a79bae17e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for user fe1c86c411834f1c8d2775a5b2c5f1d1 and project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:59:49.566327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-53bfd495-4ad4-4a6f-9abb-9a2a79bae17e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.801087 May 26 17:59:49.567176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 9/19] 10.222.0.121 () {62 vars in 1204 bytes} [Thu May 26 17:59:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 804 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 17:59:49.585308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4cd5238e-2a53-41c1-8976-5dabb4179180 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a4b7af0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:49.667184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4cd5238e-2a53-41c1-8976-5dabb4179180 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 288 microversion: 2.1 time: 0.092154 May 26 17:59:49.667915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 10/20] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:49 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:49.678720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8927869a-0fb5-4f53-8ba3-3fa4bbf3cfeb tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8ad67790>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:49.983257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8927869a-0fb5-4f53-8ba3-3fa4bbf3cfeb tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "DELETE /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 202 len: 0 microversion: 2.1 time: 0.308516 May 26 17:59:49.987795 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 11/21] 10.222.0.121 () {58 vars in 1258 bytes} [Thu May 26 17:59:49 2022] DELETE /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:59:49.993465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:49.997001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:50.016469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:50.018677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:50.022414 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:50.023212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:50.473005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:50.481475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-05ed0844-40bc-4cdc-a45c-c265fe7614e1 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1277 microversion: 2.1 time: 0.492533 May 26 17:59:50.486053 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 12/22] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:49 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1277 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:50.505690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-63b30223-54bd-4923-a440-8242699ef947 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a47bc10>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:50.568807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-63b30223-54bd-4923-a440-8242699ef947 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 200 len: 287 microversion: 2.1 time: 0.081432 May 26 17:59:50.569530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 13/23] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:50 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:50.959030 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:59:50.959574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:59:50.959933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:59:50.960347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:59:50.960854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:59:50.981749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:50.982454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:50.983505 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:50.984310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:51.044103 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:59:51.073848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for user dbee2da50ee6413db771071900703e29 and project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:59:51.111011 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:59:51.115663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:59:51.358674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-397d6c1d-f78d-43ca-9ed5-1db376c57e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.409206 May 26 17:59:51.360286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 11/24] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 17:59:47 2022] POST /compute/v2.1/servers => generated 385 bytes in 3412 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:59:51.370530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bea20ffc-6218-4f59-9105-cf7dcf722b8f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:51.371190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bea20ffc-6218-4f59-9105-cf7dcf722b8f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:51.513574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:51.514465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:51.571423 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:51.575110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:51.582625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:51.584766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:51.697213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bea20ffc-6218-4f59-9105-cf7dcf722b8f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:51.736259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bea20ffc-6218-4f59-9105-cf7dcf722b8f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1225 microversion: 2.1 time: 0.369733 May 26 17:59:51.742119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 14/25] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:51 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1225 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:51.767069 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fc8ecdef-8f5a-44d7-b1c4-465330798ab8 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a49d5e0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:51.846592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-fc8ecdef-8f5a-44d7-b1c4-465330798ab8 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] HTTP exception thrown: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. May 26 17:59:51.848683 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fc8ecdef-8f5a-44d7-b1c4-465330798ab8 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Request method failure captured: May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 HTTP/1.1 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AGM2jIoVN7SvG4AsL5S7d1VESqso_jcFHfwtndp0aZE3vks948Ew6v-l1gVL8nhhjgwVwOnhG4o-IbN9ht-jiXBS5C2rO0evGFUQ2BG5SVbuRpAljDf77GHfQLj3RpzhV8YGeLwC4ty5HuEgEsUoQ4VPmmIUPc-G5zGaeTz8Z1kek May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 17:59:51.852782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6251e828bb784b898ecf49686477f863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6251e828bb784b898ecf49686477f863", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 146896e42498467b9b42cb49d73db2e8 May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '67edbcbc-6ce2-4c7d-ae60-68727fcd6767'} May 26 17:59:51.853851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. (HTTP 404) (Request-ID: req-d43899d6-9c1f-405f-87c8-be18418cab55) May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.856557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:51.857449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 17:59:51.860730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fc8ecdef-8f5a-44d7-b1c4-465330798ab8 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Returning 404 to user: Snapshot 67edbcbc-6ce2-4c7d-ae60-68727fcd6767 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:59:51.861678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fc8ecdef-8f5a-44d7-b1c4-465330798ab8 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767" status: 404 len: 111 microversion: 2.1 time: 0.109159 May 26 17:59:51.865182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 15/26] 10.222.0.121 () {58 vars in 1255 bytes} [Thu May 26 17:59:51 2022] GET /compute/v2.1/os-snapshots/67edbcbc-6ce2-4c7d-ae60-68727fcd6767 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:59:51.865282 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3cdcfd12-0fc7-4e2b-9db5-0d5a02bd595b tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1277 microversion: 2.1 time: 0.354460 May 26 17:59:51.866448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 12/27] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:51 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:51.887396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f80fec1e-bcbb-4ba7-985a-6bf8593dee7c tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8bfe21f0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:52.096853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993524423", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:52.187280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f80fec1e-bcbb-4ba7-985a-6bf8593dee7c tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 202 len: 0 microversion: 2.1 time: 0.324815 May 26 17:59:52.192363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 16/28] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 17:59:51 2022] DELETE /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:59:52.204872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eec79f46-e250-4942-aa1e-d7add8b2baa2 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a47ba60>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:52.285532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] validate_networks() for [('8c20ae16-163c-4137-8a9f-95e057614528', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:59:52.360004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:59:52.397393 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eec79f46-e250-4942-aa1e-d7add8b2baa2 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 200 len: 345 microversion: 2.1 time: 0.203468 May 26 17:59:52.409137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 17/29] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 17:59:52 2022] GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 345 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:59:52.972218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:52.972218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:52.972218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:52.972218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:52.975223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:52.975223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:53.873236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:59:53.875090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:59:53.876418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:59:53.877033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:59:53.877629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:59:53.912639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:53.921885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:53.921885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:53.921885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:54.029690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:59:54.046800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for user dbee2da50ee6413db771071900703e29 and project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:59:54.115568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:59:54.129681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:59:54.156971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:54.180836 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cc229061-01b5-48c2-94ed-9bd9490fba37 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 1.298472 May 26 17:59:54.190883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 18/30] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:52 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:59:54.202029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1f3faa52-bb90-4191-bdbd-a84dd5d0e72f tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b89be4820>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:54.305578 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-1f3faa52-bb90-4191-bdbd-a84dd5d0e72f tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] HTTP exception thrown: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1f3faa52-bb90-4191-bdbd-a84dd5d0e72f tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Request method failure captured: May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 HTTP/1.1 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AGM2jIoVN7SvG4AsL5S7d1VESqso_jcFHfwtndp0aZE3vks948Ew6v-l1gVL8nhhjgwVwOnhG4o-IbN9ht-jiXBS5C2rO0evGFUQ2BG5SVbuRpAljDf77GHfQLj3RpzhV8YGeLwC4ty5HuEgEsUoQ4VPmmIUPc-G5zGaeTz8Z1kek May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 17:59:54.313954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6251e828bb784b898ecf49686477f863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6251e828bb784b898ecf49686477f863", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 146896e42498467b9b42cb49d73db2e8 May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '2e313be4-2d81-4802-956f-386a95e33000'} May 26 17:59:54.315405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. (HTTP 404) (Request-ID: req-f4800019-b17f-4f3c-a6fa-0f2d29e3eb70) May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.316268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:54.317463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:59:54.327986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1f3faa52-bb90-4191-bdbd-a84dd5d0e72f tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Returning 404 to user: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1f3faa52-bb90-4191-bdbd-a84dd5d0e72f tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 404 len: 109 microversion: 2.1 time: 0.132992 May 26 17:59:54.329234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 19/31] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 17:59:54 2022] GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:59:54.353104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cba3fbde-cbe9-42d9-8f34-588d3e6e0b66 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b89be45e0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:54.353551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0d767bd8-6d38-4a4d-9c82-6af1e737ca22 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.260453 May 26 17:59:54.357753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 13/32] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 17:59:52 2022] POST /compute/v2.1/servers => generated 385 bytes in 2267 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 17:59:54.378331 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a32fa154-ecc9-480f-a4a6-2647c6c7680c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:54.382724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a32fa154-ecc9-480f-a4a6-2647c6c7680c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:54.519416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-cba3fbde-cbe9-42d9-8f34-588d3e6e0b66 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] HTTP exception thrown: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cba3fbde-cbe9-42d9-8f34-588d3e6e0b66 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Request method failure captured: May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 HTTP/1.1 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AGM2jIoVN7SvG4AsL5S7d1VESqso_jcFHfwtndp0aZE3vks948Ew6v-l1gVL8nhhjgwVwOnhG4o-IbN9ht-jiXBS5C2rO0evGFUQ2BG5SVbuRpAljDf77GHfQLj3RpzhV8YGeLwC4ty5HuEgEsUoQ4VPmmIUPc-G5zGaeTz8Z1kek May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 17:59:54.522707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6251e828bb784b898ecf49686477f863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6251e828bb784b898ecf49686477f863", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 146896e42498467b9b42cb49d73db2e8 May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '2e313be4-2d81-4802-956f-386a95e33000'} May 26 17:59:54.524125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. (HTTP 404) (Request-ID: req-c483f06e-793f-4ec6-9f26-1bfc8e31dd25) May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.525302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:59:54.526921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 17:59:54.528111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.529167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.531822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cba3fbde-cbe9-42d9-8f34-588d3e6e0b66 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Returning 404 to user: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:59:54.533518 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cba3fbde-cbe9-42d9-8f34-588d3e6e0b66 tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 404 len: 109 microversion: 2.1 time: 0.204773 May 26 17:59:54.536062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 20/33] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 17:59:54 2022] DELETE /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 109 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:59:54.575298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-65efc9fa-4fd3-41a3-bdb5-41085f9284ec tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Calling method '.version_select at 0x7f4b8a47bd30>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:54.740823 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-65efc9fa-4fd3-41a3-bdb5-41085f9284ec tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] HTTP exception thrown: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-65efc9fa-4fd3-41a3-bdb5-41085f9284ec tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Request method failure captured: May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 HTTP/1.1 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AGM2jIoVN7SvG4AsL5S7d1VESqso_jcFHfwtndp0aZE3vks948Ew6v-l1gVL8nhhjgwVwOnhG4o-IbN9ht-jiXBS5C2rO0evGFUQ2BG5SVbuRpAljDf77GHfQLj3RpzhV8YGeLwC4ty5HuEgEsUoQ4VPmmIUPc-G5zGaeTz8Z1kek May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 17:59:54.743386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/6251e828bb784b898ecf49686477f863"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/6251e828bb784b898ecf49686477f863"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_6251e828bb784b898ecf49686477f863", "adminURL": "http://10.222.0.121:8080"}]}] May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 6251e828bb784b898ecf49686477f863 May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-539241919 May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 146896e42498467b9b42cb49d73db2e8 May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-539241919-project May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '2e313be4-2d81-4802-956f-386a95e33000'} May 26 17:59:54.744696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. (HTTP 404) (Request-ID: req-ccc54050-6ac3-43f0-9a58-2139414d471e) May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.745463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:59:54.746640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:59:54.747760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. May 26 17:59:54.748807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 17:59:54.751133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-65efc9fa-4fd3-41a3-bdb5-41085f9284ec tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] Returning 404 to user: Volume 2e313be4-2d81-4802-956f-386a95e33000 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:59:54.752353 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-65efc9fa-4fd3-41a3-bdb5-41085f9284ec tempest-VolumesSnapshotsTestJSON-539241919 tempest-VolumesSnapshotsTestJSON-539241919-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000" status: 404 len: 109 microversion: 2.1 time: 0.213504 May 26 17:59:54.753549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 21/34] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 17:59:54 2022] GET /compute/v2.1/os-volumes/2e313be4-2d81-4802-956f-386a95e33000 => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:59:55.143613 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a32fa154-ecc9-480f-a4a6-2647c6c7680c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:55.163005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a32fa154-ecc9-480f-a4a6-2647c6c7680c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1225 microversion: 2.1 time: 0.795327 May 26 17:59:55.165182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 14/35] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:54 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1225 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:55.200753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:55.201497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:55.239328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:55.274032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:55.274032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:55.274032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:56.126782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:56.141645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b7ee2160-a6bc-4bdf-a0d3-f0d394722b12 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.946751 May 26 17:59:56.158425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 22/36] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:55 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:56.192772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d17c7354-670c-4dcd-8e53-ed05035b72c2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:56.198070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d17c7354-670c-4dcd-8e53-ed05035b72c2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:56.521629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d17c7354-670c-4dcd-8e53-ed05035b72c2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:56.525867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d17c7354-670c-4dcd-8e53-ed05035b72c2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1225 microversion: 2.1 time: 0.345437 May 26 17:59:56.538741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 15/37] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:56 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1225 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:56.625266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8bf259f5-4dbc-462a-aae3-e74c62cb27ad tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: .version_select at 0x7f4b89be4ca0>, body: {"keypair": {"name": "tempest-keypair-1647405369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxu2CZvWOmX5NWNU0uu909OdVAP1TwGPpDytlKdh+bT5GSp51bAXbF94mUhPpBEObs0JMB+0oLwsafTGgOa0G7rXOKPxYZ/ZO0whwhSTwk91lXZy4ubkAazT3odQ6L+7w=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:59:56.682693 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-8bf259f5-4dbc-462a-aae3-e74c62cb27ad tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:59:56.698656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-8bf259f5-4dbc-462a-aae3-e74c62cb27ad tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:59:56.885781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8bf259f5-4dbc-462a-aae3-e74c62cb27ad tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.457515 May 26 17:59:56.885781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 23/38] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 17:59:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:59:57.165838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:57.166014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:57.177815 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:57.181723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:57.182845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:57.184785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:57.544936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:57.545574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:57.570055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:57.570977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:57.596454 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:57.597586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:58.562190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:58.583498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0793af24-4020-4da8-be25-6e21c28ec4ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1221 microversion: 2.1 time: 1.043536 May 26 17:59:58.601014 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 24/39] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:57 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1221 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:59.027138 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:59.043519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a9a3c9ef-787f-497f-afd5-e1f51c6bfdd3 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 1.881674 May 26 17:59:59.045476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 16/40] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:57 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:59:59.604858 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:59:59.605486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:59:59.620382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:59.620845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:59.621675 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:59:59.622121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:59:59.873032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:59:59.891294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ed7defa2-8c34-4b34-b7f3-3b33042c50bd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1283 microversion: 2.1 time: 0.289788 May 26 17:59:59.906398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 25/41] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 17:59:59 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1283 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:00.062605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:00.063678 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:00.082391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:00.087195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:00.088218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:00.088764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:00.914671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:00.916007 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:00.933684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:00.934691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:00.938959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:00.942637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:01.017939 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:01.031356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5d282460-e091-4fd3-9921-ffa45de719ea tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.973116 May 26 18:00:01.036534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 17/42] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:00 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:01.475768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-845e2d3d-3686-4f12-ab53-b217710266fe req-410dc683-fda9-472a-98c1-b0a4e44491ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471b2b61-2a00-4e45-b10a-a118ecaa546e", "tag": "24ce99e8-5fa8-4285-860e-6ac3b637f96f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:01.501836 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-845e2d3d-3686-4f12-ab53-b217710266fe req-410dc683-fda9-472a-98c1-b0a4e44491ae service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:01.505045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-845e2d3d-3686-4f12-ab53-b217710266fe req-410dc683-fda9-472a-98c1-b0a4e44491ae service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:01.558258 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-845e2d3d-3686-4f12-ab53-b217710266fe req-410dc683-fda9-472a-98c1-b0a4e44491ae service nova] Creating event network-changed:24ce99e8-5fa8-4285-860e-6ac3b637f96f for instance 471b2b61-2a00-4e45-b10a-a118ecaa546e on hv-cinder-83607 May 26 18:00:01.571674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-845e2d3d-3686-4f12-ab53-b217710266fe req-410dc683-fda9-472a-98c1-b0a4e44491ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=130100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:00:01.573664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:01.574569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:01.575629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:01.576236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:01.600531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.compute.rpcapi [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:00:01.601998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] Releasing lock "compute-rpcapi-router" {{(pid=130100) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:00:01.642979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f10d0bad-6227-4a86-b00c-8ce7e1ae907c None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.583358 May 26 18:00:01.643811 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 18/43] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:00:01.712492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:01.767872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-579fe4b2-6c77-4c1e-b6ea-cd519484d90e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1283 microversion: 2.1 time: 0.858367 May 26 18:00:01.773750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 26/44] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:00 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1283 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:02.054696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:02.061510 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:02.084740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:02.089225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:02.102076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:02.105196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:02.454387 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:02.467558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9d7dfe11-f943-4def-bf23-573562b5abee tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.413584 May 26 18:00:02.469463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 19/45] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:02 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:02.790006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:02.790684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:02.807395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:02.807862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:02.808795 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:02.809654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:03.054132 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:03.097337 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c267bf9b-11fd-4fc7-8e69-02e4011e70e8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1283 microversion: 2.1 time: 0.311057 May 26 18:00:03.099763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 27/46] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:02 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1283 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:03.487876 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:03.490015 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:03.504332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:03.506263 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:03.507090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:03.507535 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:03.661237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1098334972", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1050f433-8bfb-4b2f-a703-d9cd6244e4ba"}], "security_groups": [{"name": "tempest-securitygroup--2108543983"}], "key_name": "tempest-keypair-1203171491", "user_data": "}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:04.644616 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:04.658434 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2af49a7a-fbd3-45a6-8b7c-62090b004fac tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 1.176507 May 26 18:00:04.668651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 20/47] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:03 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:04.700058 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:04.700730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:04.727069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:04.727691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:04.732707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:04.733181 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:04.891479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] validate_networks() for [('1050f433-8bfb-4b2f-a703-d9cd6244e4ba', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:00:05.554959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:05.646409 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:05.654967 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bc1ec441-d3ae-4149-9a17-ae24f67e278b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.979465 May 26 18:00:05.655560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 21/48] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:04 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:05.686228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:05.687808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:05.699551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:05.707595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:05.709507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:05.710327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:06.525915 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=22 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:06.734678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=16 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:06.926562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:00:06.926734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:00:06.927188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:00:06.927611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:00:06.928026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:00:06.929865 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:06.943721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-68133899-fd76-4705-80ec-26588b045fd6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 1.261437 May 26 18:00:06.955560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 22/49] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:05 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:06.959704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:06.959704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:06.959704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:06.959704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:06.980228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=51 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:06.992627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:00:06.997264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for user fe1c86c411834f1c8d2775a5b2c5f1d1 and project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:00:07.014737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:00:07.018253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:00:07.047121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-b9792b79-58a2-4a6e-afa4-9cb9cfbcf33d req-1a39cf18-a901-4535-b4c7-6ad9367f8244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b24c05-9d81-4199-8295-d51b05cb919f", "tag": "2d454edc-2998-4b2b-a787-49fda244cb59"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:07.058604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-b9792b79-58a2-4a6e-afa4-9cb9cfbcf33d req-1a39cf18-a901-4535-b4c7-6ad9367f8244 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.059662 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-b9792b79-58a2-4a6e-afa4-9cb9cfbcf33d req-1a39cf18-a901-4535-b4c7-6ad9367f8244 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:07.076712 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-b9792b79-58a2-4a6e-afa4-9cb9cfbcf33d req-1a39cf18-a901-4535-b4c7-6ad9367f8244 service nova] Creating event network-changed:2d454edc-2998-4b2b-a787-49fda244cb59 for instance 25b24c05-9d81-4199-8295-d51b05cb919f on hv-cinder-83607 May 26 18:00:07.083340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-b9792b79-58a2-4a6e-afa4-9cb9cfbcf33d req-1a39cf18-a901-4535-b4c7-6ad9367f8244 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121324 May 26 18:00:07.084278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 23/50] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:07.113093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:07.113910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:07.121200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.121919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:07.122911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.123598 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:07.198313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2fd73d60-0fce-4741-b893-c048c5fec5e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 3.543278 May 26 18:00:07.200025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 28/51] 10.222.0.121 () {62 vars in 1192 bytes} [Thu May 26 18:00:03 2022] POST /compute/v2.1/servers => generated 404 bytes in 3546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 26 18:00:07.221246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:07.222511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:07.529837 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:07.543006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:07.550684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:07.570261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-579d06e2-6d35-4e43-96d3-a9c1ca4fb255 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1286 microversion: 2.20 time: 0.345247 May 26 18:00:07.574311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 29/52] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:07 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1286 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:07.639275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:07.652642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8594b92f-a817-4553-8629-df9f971475f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.566900 May 26 18:00:07.654053 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 24/53] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:07 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:07.972441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-2061bf55-a33b-45df-b59f-9f16f205ca6e req-e9037a7a-f087-4ea8-9b4b-caf14bd4ebfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5aa272-8509-4b29-80a1-8db933234ecc", "tag": "41c660b7-e9d5-45bc-89db-4b3e93ffd8cd"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:07.978017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:07.978650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:07.985965 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.986644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:07.989688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.989688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:07.991160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2061bf55-a33b-45df-b59f-9f16f205ca6e req-e9037a7a-f087-4ea8-9b4b-caf14bd4ebfc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:07.991685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2061bf55-a33b-45df-b59f-9f16f205ca6e req-e9037a7a-f087-4ea8-9b4b-caf14bd4ebfc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:08.043817 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-2061bf55-a33b-45df-b59f-9f16f205ca6e req-e9037a7a-f087-4ea8-9b4b-caf14bd4ebfc service nova] Creating event network-changed:41c660b7-e9d5-45bc-89db-4b3e93ffd8cd for instance 1b5aa272-8509-4b29-80a1-8db933234ecc on hv-cinder-83607 May 26 18:00:08.059482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-2061bf55-a33b-45df-b59f-9f16f205ca6e req-e9037a7a-f087-4ea8-9b4b-caf14bd4ebfc service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090827 May 26 18:00:08.060968 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 25/54] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:08.228210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-542483642", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd0758f-2a58-48c2-a018-de67fccda659"}], "security_groups": [{"name": "tempest-securitygroup--634468790"}], "key_name": "tempest-keypair-1647405369", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:08.228512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:08.239202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3873d84c-c1b8-45ba-a8db-233485ab29e0 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.275360 May 26 18:00:08.247469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 30/55] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:07 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:08.385666 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] validate_networks() for [('ccd0758f-2a58-48c2-a018-de67fccda659', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:00:08.592940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:08.597878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:08.731584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:08.740540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:08.749869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:08.751599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eea80a64-403d-493f-8098-7a5834f69295 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1286 microversion: 2.20 time: 0.162755 May 26 18:00:08.752385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 31/56] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:08 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:08.772848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:08.772848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:08.782291 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:08.783013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:08.784105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:08.785000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.064303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:00:09.064823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:00:09.065364 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:00:09.065979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:00:09.066465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:00:09.082062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.083578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.083578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.084024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.109965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:00:09.115230 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:00:09.128861 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:00:09.131808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:00:09.222095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.235602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-214540bf-fab7-4b79-94d4-eea7e531e5c8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.481949 May 26 18:00:09.240310 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 32/57] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:08 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:09.257459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:09.258070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:09.264316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.264767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.265571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.266006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.365401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8da37a9a-7a96-437b-ab28-9f3b11bf0afb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.142628 May 26 18:00:09.366495 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 26/58] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:00:08 2022] POST /compute/v2.1/servers => generated 403 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 18:00:09.377310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e1a1c0b5-3383-4390-827c-aa7b557909a3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:09.378199 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e1a1c0b5-3383-4390-827c-aa7b557909a3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:09.481455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.490355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-75af01a4-70cc-47c6-955b-dfbdec625072 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.236835 May 26 18:00:09.499894 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 33/59] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:09 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:09.502548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e1a1c0b5-3383-4390-827c-aa7b557909a3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.516153 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e1a1c0b5-3383-4390-827c-aa7b557909a3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1245 microversion: 2.1 time: 0.141085 May 26 18:00:09.526286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 27/60] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:09 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:09.770552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:09.771241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:09.778001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.778456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.779504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:09.779950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:09.845338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.855711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.857729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:09.858680 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b0954963-1dcc-4da3-a494-628a6d815203 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.093036 May 26 18:00:09.859306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 34/61] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:09 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:10.253352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:10.253923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:10.255924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:10.262903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.265130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.266508 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.267434 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.420275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.432049 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e0b40f9a-2a32-4431-a621-c54cc82c8877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.183855 May 26 18:00:10.432637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 28/62] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:10 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:10.508047 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:10.509868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:10.515213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.515752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.516702 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.517142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.549403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:10.550270 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:10.557157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.557965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.558757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.559234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.664405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.673426 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-928d74c4-5676-40c6-8476-ae777968f273 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.133239 May 26 18:00:10.674396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 29/63] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:10 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:10.692213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.699869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a00f6070-a34a-4e36-aff6-5c01a866d1bc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.196427 May 26 18:00:10.700438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 35/64] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:10 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:10.885524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:10.886248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:10.893580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.894144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.895247 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:10.895647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:10.898849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=81 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:10.968615 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.981062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.982965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:10.985358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e7366f0c-fb53-472c-bfba-27990508f8e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.111620 May 26 18:00:10.986276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 30/65] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:10 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:11.453227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:11.453952 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:11.460168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.460613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.461378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.461813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.621665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:11.640363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8330a420-14df-47a2-9fcb-6ac8ce9d88c1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.181996 May 26 18:00:11.640363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 36/66] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:11 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:11.702306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:11.708942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:11.720889 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:11.721599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:11.732909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.736166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.736770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.737959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.738519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.739180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.742914 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:11.743772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:11.837806 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:11.847137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2f01465a-c66a-4cdd-9a42-319dd7729b00 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.159441 May 26 18:00:11.847720 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 31/67] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:11 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:11.957365 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:11.967653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f203e8f3-4c6d-4e19-bdf4-d85c1a666151 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.253721 May 26 18:00:11.969502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 37/68] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:11 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:12.003572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:12.004199 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:12.011953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.012652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.013618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.014210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.117829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:12.117829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:12.118349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:12.118349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0532f417-842a-4355-a967-70a4aa503aae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.114816 May 26 18:00:12.118349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 32/69] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:11 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:12.650852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:12.651837 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:12.665388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.665388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.665388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.665388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.800807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:12.808619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5517a2fc-e036-431d-a9e8-1bb4a2b5d061 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.162162 May 26 18:00:12.809177 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 38/70] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:12 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:12.866042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:12.866664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:12.872856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.873307 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.874076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.874508 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.938728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:12.946033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-aad55b67-d3d6-42f2-b846-2c36a0f37b8e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.083866 May 26 18:00:12.946608 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 33/71] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:12 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:12.985989 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:12.987323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:12.997740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.998188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:12.999786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:12.999786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.134264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:13.142175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:13.149925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.155016 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.155016 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.155016 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.155414 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:13.166463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a7222080-319a-44fc-9a4a-0b205f4d42a7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.184607 May 26 18:00:13.167539 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 39/72] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:12 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:13.229050 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:13.239617 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:13.240366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:13.241718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fff34b6e-2aca-4824-8cc5-840d6732a3db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.112096 May 26 18:00:13.242443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 34/73] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:13 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:13.825468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:13.826093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:13.833244 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.833548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.834358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.834797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.963446 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:13.964114 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:13.975195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.975659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:13.976454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:13.977343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:14.023501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.035248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-06f3225e-a42a-4659-af9a-582cc7386142 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.213098 May 26 18:00:14.036363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 40/74] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:13 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:14.064385 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.078895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e1d36545-cf41-489b-a9ea-d94a026d4a92 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.114357 May 26 18:00:14.078895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 35/75] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:13 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:14.184871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:14.185739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:14.192557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:14.193157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:14.194016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:14.194515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:14.259898 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:14.260520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:14.267009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:14.267682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:14.268475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:14.268921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:14.368072 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.380097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.384103 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.387137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-952f2fa1-c083-48fb-8cf7-0d9a267ac113 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.129615 May 26 18:00:14.396109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 36/76] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:14 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:00:14.399317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:14.413805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8e9044f1-811f-4b22-adda-9ef676c54c96 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.232932 May 26 18:00:14.415633 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 41/77] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:14 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:15.053410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:15.053410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:15.060085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.060651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.061517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.062013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.094852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:15.095430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:15.106753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.107234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.108007 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.108444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.204111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.213028 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-db476947-8c4b-45f6-a0bd-d63df9131cb8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.123141 May 26 18:00:15.213723 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 42/78] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:15 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:15.271909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.289918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-353e4fd4-1b8f-4eb4-bd90-dbb9e29542f7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.241376 May 26 18:00:15.290911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 37/79] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:15 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:15.409541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:15.410569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:15.419552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.420006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.420781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.421571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.433426 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:15.434473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:15.445597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.446167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.447987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:15.447987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:15.531811 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.541547 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.543175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.544294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c82a7ec5-9aa8-423f-854c-9250eba051ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.141954 May 26 18:00:15.544850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 43/80] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:15 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:15.679248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:15.688607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-329d0f1a-65df-4cd2-ba32-dd747771bcb8 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.259270 May 26 18:00:15.701076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 38/81] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:15 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:16.232140 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:16.233275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:16.239572 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.240191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.241517 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.242103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.308642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:16.309424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:16.341629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.342213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.348779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.349267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.350698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.361632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a43beb74-8d86-42c8-a7b2-a4536e71d6b3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.133354 May 26 18:00:16.362901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 44/82] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:16 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:16.541771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.550679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c82ca579-b116-4f30-91f2-82c235c8c655 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.246825 May 26 18:00:16.552896 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 39/83] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:16 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:16.567501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:16.568317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:16.577533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.578429 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.579416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.580187 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.660606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.671425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.675919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.675919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f8b5da7e-2e3d-4ec1-82d4-43cd1e15a8ad tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.112900 May 26 18:00:16.683499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 45/84] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:16 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:00:16.705730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:16.706845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:16.733287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.733813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.744158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:16.745868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:16.934448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:16.944403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b990f4f1-5f70-45e5-a3b3-ad45399660dc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.242587 May 26 18:00:16.944967 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 40/85] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:16 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:17.381417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:17.382028 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:17.384193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:17.389032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.389483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.390254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.390689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.457244 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:17.466735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ebc06bdf-c2a5-416b-89eb-9c06b4a03bb7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1249 microversion: 2.1 time: 0.089153 May 26 18:00:17.467348 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 46/86] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:17 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:17.576984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:17.577653 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:17.586587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.587701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.588854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.589879 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.696241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:17.698479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:17.709261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.709724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.712277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.712728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.739766 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:17.811243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:17.814430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:17.820116 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7762820e-ec5b-4c2d-befa-b36c89b25d3c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.246895 May 26 18:00:17.820902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 41/87] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:17 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:17.838462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:17.839757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:17.842035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9de3ba9a-24e6-4d93-858c-5bbe14bc67a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1282 microversion: 2.20 time: 0.151570 May 26 18:00:17.843186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 47/88] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:17 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:00:17.961770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:17.962589 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:17.969612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.970420 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:17.971461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:17.971964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.209354 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:18.229185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cca8fb70-d0d1-41b4-bb54-d0c7a3ae41af tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.261524 May 26 18:00:18.229185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 42/89] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:17 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:18.488523 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:18.489804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:18.517752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.518531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.519696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.520178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.676740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:18.704822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ecde9ad9-4d43-4827-b3e4-3a5ccb4ce65c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1241 microversion: 2.1 time: 0.220243 May 26 18:00:18.712384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 48/90] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:18 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1241 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:18.848182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:18.849773 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:18.869882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:18.872100 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:18.885257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.892963 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.893152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=10 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:18.893152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.893152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.893500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.893500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:18.897442 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:18.900115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:19.090574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.097042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:19.112212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.117857 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.120822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4338a3f6-8812-405e-b5a3-0d7332bb4d8e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1338 microversion: 2.20 time: 0.261424 May 26 18:00:19.123168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 49/91] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:18 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1338 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:19.312628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.322800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cc44fc16-8344-4832-a888-53a7c3c77695 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.479584 May 26 18:00:19.332187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 43/92] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:18 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:19.337557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:19.338711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:19.356506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:19.357271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:19.358250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:19.359735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:19.507945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:19.806157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.821699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9405edc1-fd29-4c2b-856a-ff637672aab5 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.487916 May 26 18:00:19.822656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 44/93] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:19 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:19.827956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:19.828869 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:19.837680 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:19.838514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:19.839559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:19.840228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:19.965278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-9d1efae8-f6f3-4fc7-a0fe-b77e40ce51e9 req-8ec64909-0656-47fe-8593-22a5013c2be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471b2b61-2a00-4e45-b10a-a118ecaa546e", "name": "network-vif-plugged", "status": "completed", "tag": "24ce99e8-5fa8-4285-860e-6ac3b637f96f"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:19.987991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:19.994183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-9d1efae8-f6f3-4fc7-a0fe-b77e40ce51e9 req-8ec64909-0656-47fe-8593-22a5013c2be3 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:19.995622 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-9d1efae8-f6f3-4fc7-a0fe-b77e40ce51e9 req-8ec64909-0656-47fe-8593-22a5013c2be3 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.008731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5eb3edd0-638b-467c-8793-e6f1449fe60e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1305 microversion: 2.1 time: 0.184566 May 26 18:00:20.012705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 45/94] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:19 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:20.055119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-9d1efae8-f6f3-4fc7-a0fe-b77e40ce51e9 req-8ec64909-0656-47fe-8593-22a5013c2be3 service nova] Creating event network-vif-plugged:24ce99e8-5fa8-4285-860e-6ac3b637f96f for instance 471b2b61-2a00-4e45-b10a-a118ecaa546e on hv-cinder-83607 May 26 18:00:20.057892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-9d1efae8-f6f3-4fc7-a0fe-b77e40ce51e9 req-8ec64909-0656-47fe-8593-22a5013c2be3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 18:00:20.059347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.059807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.062036 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.066357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.112267 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.compute.rpcapi [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 18:00:20.113237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] Releasing lock "compute-rpcapi-router" {{(pid=130099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 18:00:20.137522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f0bb968b-608b-4301-acba-5d3188e5b3f4 None None] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.012916 May 26 18:00:20.138601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 50/95] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:20.145865 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:20.147433 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:20.158325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.158804 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.159628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.160075 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.235805 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:20.238552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:20.245534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:20.247206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:20.248329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-23e5c061-bb15-4d67-a389-1323cf7a46aa tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1344 microversion: 2.20 time: 0.109140 May 26 18:00:20.249102 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 46/96] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:20 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:20.348709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:20.349463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:20.357698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.358157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.359246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.359761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.531620 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:20.540199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dc89b129-1572-4ea7-a823-c9cf18ca38fc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.195730 May 26 18:00:20.540799 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 51/97] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:20 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:20.843461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:20.844340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:20.853771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.854583 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:20.855709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:20.856267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.037223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:21.039247 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:21.049044 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.049967 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.051776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.052389 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.084071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.106450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a0f36cd5-5f3e-4f7f-bfb4-3b1eabcb3fec tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.269500 May 26 18:00:21.113371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 47/98] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:20 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:21.153799 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.161787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b31630b8-27cc-4787-a1bd-6b818d6c46aa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1303 microversion: 2.1 time: 0.132244 May 26 18:00:21.162374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 52/99] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:21 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:21.274325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:21.274997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:21.288887 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.289354 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.290871 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.291916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.379934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.389233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.391912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.393819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-446d3fcb-3a17-4110-892f-443f1475ef86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1344 microversion: 2.20 time: 0.124483 May 26 18:00:21.395419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 48/100] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:21 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:21.557745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:21.558676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:21.565368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.565825 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.566619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:21.567234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:21.741556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:21.754125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d9945510-8772-4adf-a647-d116120362bb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.200379 May 26 18:00:21.765949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 53/101] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:21 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:22.129938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:22.130642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:22.141141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.141594 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.142774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.148470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.162990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-f4d3e0ea-e251-496a-93ab-9a20309e45a7 req-0900a341-271c-4a23-990b-c2c2f5c61eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b24c05-9d81-4199-8295-d51b05cb919f", "name": "network-vif-plugged", "status": "completed", "tag": "2d454edc-2998-4b2b-a787-49fda244cb59"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:22.177101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f4d3e0ea-e251-496a-93ab-9a20309e45a7 req-0900a341-271c-4a23-990b-c2c2f5c61eb8 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.183271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f4d3e0ea-e251-496a-93ab-9a20309e45a7 req-0900a341-271c-4a23-990b-c2c2f5c61eb8 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.209089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-f4d3e0ea-e251-496a-93ab-9a20309e45a7 req-0900a341-271c-4a23-990b-c2c2f5c61eb8 service nova] Creating event network-vif-plugged:2d454edc-2998-4b2b-a787-49fda244cb59 for instance 25b24c05-9d81-4199-8295-d51b05cb919f on hv-cinder-83607 May 26 18:00:22.218887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-f4d3e0ea-e251-496a-93ab-9a20309e45a7 req-0900a341-271c-4a23-990b-c2c2f5c61eb8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057566 May 26 18:00:22.226241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 54/102] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:22.233835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:22.234548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:22.251432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.252088 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.254869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.255329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.419850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:22.435891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ddddbdb1-eecf-49c9-a924-d7d91b912622 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.309042 May 26 18:00:22.435891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 49/103] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:22 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:22.452071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:22.453115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:22.469131 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.469744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.474152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.474793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.528796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:22.537518 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5a505417-1fae-4241-bf88-685a015318a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1303 microversion: 2.1 time: 0.313049 May 26 18:00:22.538432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 55/104] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:22 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1303 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:22.622094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:22.664328 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:22.668785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:22.672228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a1a41018-9983-40df-824d-17da7fa29997 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1344 microversion: 2.20 time: 0.234919 May 26 18:00:22.674789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 50/105] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:22 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1344 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:22.770541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:22.771289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:22.780212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.780756 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:22.781633 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:22.782264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.136059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:23.145136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3e1cba56-ebf5-4a91-959a-1028bd6de0d8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.378490 May 26 18:00:23.145731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 56/106] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:22 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:23.452199 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:23.453550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:23.460522 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.461334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.462282 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.463147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.555507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:23.556339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:23.562972 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.563422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.564709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.565144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.813934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:23.825099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5122d8ae-669f-435a-b26c-55e4a770ab4a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.376622 May 26 18:00:23.825835 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 51/107] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:23 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:23.839821 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:23.841280 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:23.864212 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.864845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.865711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:23.866157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:23.891598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:23.907090 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-890fdf17-f3db-432a-9d88-e89f5d2d090d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.352203 May 26 18:00:23.907833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 57/108] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:23 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:24.132821 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:24.142447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:24.145959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:24.147146 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2a9e06b3-bdd1-4ebb-b948-2e66e853d76e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.320343 May 26 18:00:24.147724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 52/109] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:23 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:24.166547 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:24.167726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:24.175486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.176187 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:24.177199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.177877 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:24.362331 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:24.369549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ab8acf20-428c-4278-a5ad-f5ff18b8cef8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.206971 May 26 18:00:24.375889 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 58/110] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:24 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:24.844643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:24.849390 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:24.865705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.866762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:24.867905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.868360 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:24.925841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:24.926466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:24.943114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.943575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:24.944398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:24.944845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.374633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.410269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-842bd95c-df3d-4df6-9c6e-62865879b1d6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1319 microversion: 2.1 time: 0.568361 May 26 18:00:25.412844 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 53/111] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:24 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:25.426703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:25.427369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:25.438732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:25.439351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.440080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:25.440514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.451142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.459934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eea0d6d6-068a-4fea-85bb-f8e2a8530edd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.539005 May 26 18:00:25.463600 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 59/112] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:24 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:25.476955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:25.477758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:25.484618 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:25.485293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.486586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:25.487329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.707978 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.718730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-90412f7f-9f81-4705-bf42-731aa78ff02f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.243275 May 26 18:00:25.719568 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 60/113] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:25 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:25.733487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-3ecfcad4-e426-4e7f-9d93-ac845eac6526 req-807d14b3-e852-4060-a31b-0a3051636b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5aa272-8509-4b29-80a1-8db933234ecc", "name": "network-vif-plugged", "status": "completed", "tag": "41c660b7-e9d5-45bc-89db-4b3e93ffd8cd"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:25.750604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-3ecfcad4-e426-4e7f-9d93-ac845eac6526 req-807d14b3-e852-4060-a31b-0a3051636b0b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:25.755168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-3ecfcad4-e426-4e7f-9d93-ac845eac6526 req-807d14b3-e852-4060-a31b-0a3051636b0b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:25.780274 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-3ecfcad4-e426-4e7f-9d93-ac845eac6526 req-807d14b3-e852-4060-a31b-0a3051636b0b service nova] Creating event network-vif-plugged:41c660b7-e9d5-45bc-89db-4b3e93ffd8cd for instance 1b5aa272-8509-4b29-80a1-8db933234ecc on hv-cinder-83607 May 26 18:00:25.781753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.786395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-3ecfcad4-e426-4e7f-9d93-ac845eac6526 req-807d14b3-e852-4060-a31b-0a3051636b0b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060220 May 26 18:00:25.787349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 61/114] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:25.792409 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.794241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:25.795826 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-163d6ca4-e8bc-49ea-ba92-bf04f76d7f4a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.381747 May 26 18:00:25.797308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 54/115] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:25 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:26.297553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-c4b84088-d474-4e66-89fa-ac69b39297c1 req-2ac47058-9e64-4841-97e4-ba55b360f49b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:26.308277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c4b84088-d474-4e66-89fa-ac69b39297c1 req-2ac47058-9e64-4841-97e4-ba55b360f49b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.309274 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c4b84088-d474-4e66-89fa-ac69b39297c1 req-2ac47058-9e64-4841-97e4-ba55b360f49b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.330284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-c4b84088-d474-4e66-89fa-ac69b39297c1 req-2ac47058-9e64-4841-97e4-ba55b360f49b service nova] Creating event network-changed:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:00:26.348449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-c4b84088-d474-4e66-89fa-ac69b39297c1 req-2ac47058-9e64-4841-97e4-ba55b360f49b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058581 May 26 18:00:26.350897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 62/116] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:26.431880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:26.432670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:26.442956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.443777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.449532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.450417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.479955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:26.480890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:26.491502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.495582 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.496898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.497715 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.773286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:26.781182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ce1cb4b3-9bd6-4c44-a616-fe9f68b5a73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.305420 May 26 18:00:26.781580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 63/117] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:26 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:26.794535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:26.796830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:26.812364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.812812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.814534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.815112 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.824296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:26.835305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-27bbb16c-c469-42f3-afa2-cb82908f7352 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1506 microversion: 2.1 time: 0.407772 May 26 18:00:26.836574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 55/118] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:26 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1506 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:26.842599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:26.843453 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:26.852361 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.853692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:26.854804 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:26.855819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.151125 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:27.155732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:27.173017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bdb00862-f851-491a-9cf8-53f5e76bfe21 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.384087 May 26 18:00:27.176533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:27.179129 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 64/119] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:26 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:27.181085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:27.183663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b692d4f9-d26a-462f-a093-5a6e8c4a9852 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.345894 May 26 18:00:27.187555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 56/120] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:26 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:27.798994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:27.800683 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:27.807827 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.808604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:27.809645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:27.810323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.022127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:28.032113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fbff8ad1-c84e-469a-ba26-48718bc992bb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.238399 May 26 18:00:28.033561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 65/121] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:27 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:28.194677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:28.195324 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:28.202616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:28.203248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:28.214940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:28.215403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.217544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:28.217995 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.218776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:28.219240 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.224227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:28.224901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.243027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:28.425951 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:28.433736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1d7850f3-c5a5-4ea2-b269-a6f02aaefc64 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1325 microversion: 2.1 time: 0.243430 May 26 18:00:28.434320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 57/122] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:28 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1325 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:28.444427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:28.446500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-ff809d9f-3f86-4ecb-965e-5f61d4e07238 req-031daed0-8edb-4a1d-9f03-8e08430b813e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a948f2ab-1a7a-4cee-b600-643f1902a6ab", "tag": "2cb12eeb-27c0-467e-84f0-7f1df273a4a2"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:28.455701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ff809d9f-3f86-4ecb-965e-5f61d4e07238 req-031daed0-8edb-4a1d-9f03-8e08430b813e service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:28.456090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ff809d9f-3f86-4ecb-965e-5f61d4e07238 req-031daed0-8edb-4a1d-9f03-8e08430b813e service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:28.456433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:28.459016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:28.461126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4755d5a1-6249-4072-90a2-221a6dac64ba tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.261755 May 26 18:00:28.471203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 66/123] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:28 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:28.471654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-ff809d9f-3f86-4ecb-965e-5f61d4e07238 req-031daed0-8edb-4a1d-9f03-8e08430b813e service nova] Creating event network-changed:2cb12eeb-27c0-467e-84f0-7f1df273a4a2 for instance a948f2ab-1a7a-4cee-b600-643f1902a6ab on hv-cinder-83607 May 26 18:00:28.480055 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-ff809d9f-3f86-4ecb-965e-5f61d4e07238 req-031daed0-8edb-4a1d-9f03-8e08430b813e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044404 May 26 18:00:28.482545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 58/124] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:29.050151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:29.050779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:29.057576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.058027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.058802 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.059269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.233568 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:29.246233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d272e26d-fa5e-484e-8e54-60bc9abe9897 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.200377 May 26 18:00:29.247087 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 67/125] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:29 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:29.351987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bde8959d-c4d9-49cf-9f54-34b2a251bc09"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:29.353191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:29.368288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.368793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.369651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.370254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.453460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:29.454111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:29.461433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.461931 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.462792 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.463245 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.636686 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:29.645521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4e8822da-3d2a-4a9b-80e4-cdebba5f6ecd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1518 microversion: 2.1 time: 0.197306 May 26 18:00:29.658461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 68/126] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:29 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:29.662433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:29.663105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:29.665747 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:29.670947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.671443 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.672222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.672829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.846031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:29.855899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:29.857409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:29.858603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6c14d4ec-0cdd-416b-bf2d-d380c1114f9a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.211380 May 26 18:00:29.859272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 69/127] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:29 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:29.875339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:29.876466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:29.883412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.883862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.884644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:29.885087 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:29.949448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'flavor' on Instance uuid 1b5aa272-8509-4b29-80a1-8db933234ecc {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:00:30.104959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:30.443486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2cc0d2e3-1310-4b1f-b7aa-fd8096fdc644 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc/action" status: 200 len: 32 microversion: 2.1 time: 0.571979 May 26 18:00:30.444102 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 70/128] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:00:29 2022] POST /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc/action => generated 32 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:00:30.449513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:30.450201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:30.456667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.457123 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:30.457883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.458319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:30.614675 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:30.623060 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-19d752da-162a-4b35-af40-a760d5c52097 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.177717 May 26 18:00:30.623698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 71/129] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:30 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:30.629532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:30.630146 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:30.636480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.637083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:30.637858 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.638435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:30.924807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:30.932382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d687d6f2-bcf1-4616-a55d-ce50d3b7feef tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.307581 May 26 18:00:30.932959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 72/130] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:30 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:30.937658 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:30.938262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:30.944983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.945717 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:30.946495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:30.946961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:31.109815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:31.125561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:31.128751 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:31.129919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3cbca54f-7b55-448f-8ed1-4ca457be0aa7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.196001 May 26 18:00:31.130484 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 73/131] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:30 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:31.641277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:31.642107 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:31.649270 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:31.649894 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:31.650661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:31.651133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:31.803455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:31.812023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4f680097-38f7-48d2-993e-de5c4b161c0c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.175147 May 26 18:00:31.812597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 74/132] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:31 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:31.951605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:31.952211 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:31.959411 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:31.959857 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:31.960902 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:31.961514 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:32.135178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:32.143406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-86062dd5-0ca2-44e3-a95f-8071dabe872b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.195370 May 26 18:00:32.143991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 75/133] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:31 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:32.148630 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:32.149241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:32.155664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:32.156117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:32.157052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:32.157497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:32.333873 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:32.341926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:32.343467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:32.346504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-249d8a01-3d33-42ad-88c8-71b114a22cbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.201336 May 26 18:00:32.349750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 76/134] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:32 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:32.832427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:32.833195 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:32.840584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:32.841120 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:32.841965 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:32.842465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:32.988797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:32.997283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a1fcb11b-68ce-4e1f-9769-9e9a355e3c35 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.172083 May 26 18:00:32.997871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 77/135] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:32 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:33.160759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:33.161430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:33.167741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:33.168185 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:33.168946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:33.169379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:33.473292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:33.475868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-88b11127-a7e3-4b91-a37e-cba3bca9372d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.319239 May 26 18:00:33.476603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 78/136] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:33 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:33.481903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:33.482880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:33.490860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:33.491434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:33.492334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:33.493423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:33.835691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:33.853008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:33.854520 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:33.855701 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f38431ed-4a61-4069-a07e-6290fd9e710a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.377907 May 26 18:00:33.865114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 79/137] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:33 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:34.014281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:34.015109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:34.022184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.023004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:34.024027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.024774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:34.347352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:34.364627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d4a17eff-a510-4791-859a-e22bf852728d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.354183 May 26 18:00:34.365835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 80/138] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:34 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:34.506679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:34.508137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:34.521508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.522768 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:34.524154 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.524731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:34.536774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:34.629476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-38fc83d5-a2f8-4961-9de0-0b505ff33471 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "POST /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.282050 May 26 18:00:34.630300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 59/139] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:00:29 2022] POST /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e/os-volume_attachments => generated 194 bytes in 5284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:34.691246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:34.700535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b171e61e-7897-43a3-a378-535b86d5b145 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.210087 May 26 18:00:34.701116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 81/140] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:34 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:34.874047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:34.874739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:34.881753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.882271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:34.883109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:34.886262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.224193 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:35.232675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:35.234250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:35.235389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-741b60ac-68de-4948-800a-9d3bcf61b42a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.365541 May 26 18:00:35.236096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 60/141] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:34 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:35.382935 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:35.384224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:35.390438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:35.390924 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.391797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:35.392844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.546732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:35.556091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fa3b2d16-15ff-4642-8542-80dcc1a9b38a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.177201 May 26 18:00:35.557148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-243f5ad1-6906-4e87-b91d-f16546353d28 req-78e7c57b-8949-4b18-a607-744ae771b580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "name": "network-vif-plugged", "status": "completed", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:35.557892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 82/142] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:35 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:35.569992 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-243f5ad1-6906-4e87-b91d-f16546353d28 req-78e7c57b-8949-4b18-a607-744ae771b580 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:35.570436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-243f5ad1-6906-4e87-b91d-f16546353d28 req-78e7c57b-8949-4b18-a607-744ae771b580 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.586670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-243f5ad1-6906-4e87-b91d-f16546353d28 req-78e7c57b-8949-4b18-a607-744ae771b580 service nova] Creating event network-vif-plugged:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:00:35.591200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-243f5ad1-6906-4e87-b91d-f16546353d28 req-78e7c57b-8949-4b18-a607-744ae771b580 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041446 May 26 18:00:35.594668 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 61/143] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:00:35.723640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:35.725698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:35.745516 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:35.746571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.747750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:35.748215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:35.922457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:35.934062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-712f0472-561f-49a9-9fa6-8af36b73faa9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.218428 May 26 18:00:35.944232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 83/144] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:35 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:36.256401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:36.258477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:36.266070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.266682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.268524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.274430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.446225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:36.455890 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:36.457982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:36.459213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-80885057-2de1-457d-bfe3-718defd59561 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.209008 May 26 18:00:36.459960 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 62/145] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:36 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:36.575841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:36.576456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:36.583586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.584034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.586220 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.586666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.727959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:36.735470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0ef12926-6304-4e28-8b80-11e5674082c0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.163828 May 26 18:00:36.736145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 84/146] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:36 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:36.951803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:36.952415 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:36.959663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.960121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.960900 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:36.961341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:36.976490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:37.101401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:37.113042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-489b9ca9-fc92-45bd-bab7-1fad2aca989d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.164917 May 26 18:00:37.113641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 63/147] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:36 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:37.477545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:37.478159 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:37.484575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:37.485033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:37.485807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:37.486538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:37.619432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-e43121af-1b34-4ab4-872f-85207985c34e req-ac24fb38-df4d-4209-8a79-d34ffac1bf71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a948f2ab-1a7a-4cee-b600-643f1902a6ab", "name": "network-vif-plugged", "status": "completed", "tag": "2cb12eeb-27c0-467e-84f0-7f1df273a4a2"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:37.624447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:37.636980 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:37.638488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:37.646638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-e43121af-1b34-4ab4-872f-85207985c34e req-ac24fb38-df4d-4209-8a79-d34ffac1bf71 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:37.646782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-e43121af-1b34-4ab4-872f-85207985c34e req-ac24fb38-df4d-4209-8a79-d34ffac1bf71 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:37.654923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-939c68b5-a083-4efb-bcd6-1d8f9dfeb5e5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.167206 May 26 18:00:37.665439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 85/148] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:37 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:37.672725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-e43121af-1b34-4ab4-872f-85207985c34e req-ac24fb38-df4d-4209-8a79-d34ffac1bf71 service nova] Creating event network-vif-plugged:2cb12eeb-27c0-467e-84f0-7f1df273a4a2 for instance a948f2ab-1a7a-4cee-b600-643f1902a6ab on hv-cinder-83607 May 26 18:00:37.678459 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-e43121af-1b34-4ab4-872f-85207985c34e req-ac24fb38-df4d-4209-8a79-d34ffac1bf71 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065640 May 26 18:00:37.679327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 64/149] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:00:37.756155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:37.756976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:37.763292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:37.763737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:37.764501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:37.764931 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:37.958579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:37.968485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-29ba37b3-1e87-4d9e-81ec-2c07dfc7e28b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.218925 May 26 18:00:37.969075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 86/150] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:37 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:38.132278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:38.150021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:38.150021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.150021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:38.150021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.150675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:38.297942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:38.300018 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9b4e9c61-0c38-44c9-a129-60fb4668be35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.173938 May 26 18:00:38.300528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 65/151] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:38 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:38.672286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:38.673013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:38.682464 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.682988 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:38.683756 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.684202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:38.828955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:38.837652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:38.839169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:38.840339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9c806153-9bba-400a-a6d4-04034a839cf6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.172143 May 26 18:00:38.840914 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 87/152] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:38 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:38.985891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:38.986660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:38.994848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.995348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:38.996118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:38.996558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:39.187708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:39.195254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2b190550-8525-4872-8ab4-b5df6677d71d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.213559 May 26 18:00:39.195816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 66/153] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:38 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:39.317031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:39.317637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:39.324213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:39.324661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:39.325448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:39.325882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:39.465936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:39.474475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2ec04a15-c602-4b3f-92ce-82153674ac82 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.161388 May 26 18:00:39.475144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 88/154] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:39 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:39.868886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:39.869502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:39.880205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:39.882393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:39.884400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:39.885088 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:40.044141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:40.051082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:40.052597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:40.053910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9bdba301-ca3a-4ea7-8f04-dcecd6f28898 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.191917 May 26 18:00:40.055309 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 67/155] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:39 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:40.212739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:40.213360 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:40.219673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:40.219953 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:40.220726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:40.221395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:40.363469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:40.371826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-46043a1c-bbe4-4290-9c73-49c40cdc4984 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.162647 May 26 18:00:40.372884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 89/156] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:40 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:40.492745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:40.493357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:40.500051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:40.500432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:40.501188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:40.501618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:40.646900 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:40.655765 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bc7c7854-5945-427f-a56c-7d5d9421ac56 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.167067 May 26 18:00:40.656652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 68/157] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:40 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:41.073381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:41.074056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:41.081271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.081789 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.082629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.083162 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.236940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:41.245532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:41.246958 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:41.248351 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-64ea5ae8-fc23-41ca-acfa-455e448e3ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.179003 May 26 18:00:41.260934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 90/158] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:41 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:41.390801 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:41.402929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:41.402929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.402929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.402929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.403595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.533251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:41.542244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-90f74b9d-ded9-41cd-afe9-3402c5b29ecf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.155652 May 26 18:00:41.542752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 69/159] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:41 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:41.673127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:41.673743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:41.681237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.681778 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.682638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:41.683109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:41.841513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:41.847212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c1355e58-b444-4e70-a3c7-2469e06334eb tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.178097 May 26 18:00:41.847786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 91/160] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:41 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:42.268377 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:42.269649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:42.280591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.280591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:42.280591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.280591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:42.420244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:42.429170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:42.430810 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:42.431944 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-eab17b0a-12f1-4576-a07a-d78865d35903 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1412 microversion: 2.20 time: 0.169197 May 26 18:00:42.432491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 70/161] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:42 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1412 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:42.560818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:42.561473 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:42.569641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.570482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:42.571525 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.571968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:42.724825 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:42.732712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c0ae5998-52da-44ad-bd07-f6ed3e3b075c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.176294 May 26 18:00:42.734286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 92/162] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:42 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:42.864048 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:42.864697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:42.871488 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.871936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:42.872693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:42.873129 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.008234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:43.016064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f808f23e-7d8b-4e31-9811-29d94ab25b28 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.155797 May 26 18:00:43.017071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 71/163] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:42 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:43.450926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:43.451543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:43.458292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.458746 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.459787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.460233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.602062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:43.612484 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:43.614685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:43.616114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b84e4bad-7c82-47d7-8afd-9e0b0ec0de16 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1605 microversion: 2.20 time: 0.169187 May 26 18:00:43.617760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 93/164] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:00:43 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:00:43.635961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:43.636541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:43.642629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.642953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.643448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.643881 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.735372 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ca623c6a-d411-4541-b97a-9feb5aee39f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.103116 May 26 18:00:43.735972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 72/165] 10.222.0.121 () {60 vars in 1320 bytes} [Thu May 26 18:00:43 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:00:43.751737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:43.752622 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:43.759179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.759783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.762412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:43.762412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:43.928392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:43.936718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a6c328c6-f82e-4922-9e17-9ccca6cae117 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.188754 May 26 18:00:43.937725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 94/166] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:43 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:44.038479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:44.039126 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:44.042144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=90 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:44.048355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:44.048355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:44.049215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:44.049717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:44.241015 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:44.249739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-332c8107-bd99-4177-912b-4d7181f55828 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.216449 May 26 18:00:44.250442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 73/167] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:44 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:44.955574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:44.956180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:44.964424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:44.964951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:44.965736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:44.966173 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.125501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:45.134026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-af43fa29-dcf7-4b00-97d0-d503d686daba tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.182257 May 26 18:00:45.134605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 95/168] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:44 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:45.212701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-ab7855a2-fc10-47cd-92c6-bf7aabbb3ff1 req-e720e04a-39ad-46bd-85ff-2126cdff1d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:45.222039 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ab7855a2-fc10-47cd-92c6-bf7aabbb3ff1 req-e720e04a-39ad-46bd-85ff-2126cdff1d59 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:45.223329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ab7855a2-fc10-47cd-92c6-bf7aabbb3ff1 req-e720e04a-39ad-46bd-85ff-2126cdff1d59 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.235502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-ab7855a2-fc10-47cd-92c6-bf7aabbb3ff1 req-e720e04a-39ad-46bd-85ff-2126cdff1d59 service nova] Creating event network-changed:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:00:45.243487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-ab7855a2-fc10-47cd-92c6-bf7aabbb3ff1 req-e720e04a-39ad-46bd-85ff-2126cdff1d59 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035159 May 26 18:00:45.244289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 74/169] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:45.266983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:45.267815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:45.275282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:45.275744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.276556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:45.276996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.435868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:45.444602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-05268af4-599d-4d35-b040-2e3b60221303 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.181562 May 26 18:00:45.445127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 96/170] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:45 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:45.595644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:45.596496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:45.610081 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:45.613458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.614349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:45.615052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:45.672102 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:00:46.151487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:46.152103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:46.159169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.159882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.160855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.161493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.165030 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-031d7898-8d01-49ea-bb92-e53b2577916a tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "DELETE /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 204 len: 0 microversion: 2.1 time: 0.575170 May 26 18:00:46.165872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 75/171] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:00:45 2022] DELETE /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:00:46.190621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:46.192543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:46.200019 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.200480 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.201264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.201708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.433905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:46.436180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:46.443540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c75ee8aa-5416-4b05-8eb9-401bef8664a5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1370 microversion: 2.1 time: 0.295791 May 26 18:00:46.454253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 97/172] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:46 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:46.465040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:46.465655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:46.475682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.476259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.483118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:46.484191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:46.520019 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:46.533855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-26e09abb-2689-42d9-8cb6-81bcd870e62e tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1558 microversion: 2.1 time: 0.347852 May 26 18:00:46.535699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 76/173] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:46 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1558 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:46.649849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:46.658123 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ab36e513-47ae-419d-9405-69a2512db0e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.196972 May 26 18:00:46.658936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 98/174] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:46 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:47.461631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:47.462250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:47.469643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.470099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.471149 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.471456 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.552647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:47.553269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:47.559875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.568699 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.569833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.570749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.691407 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:47.700516 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b483d8d3-4a84-41df-8804-704d125ea332 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1559 microversion: 2.1 time: 0.244601 May 26 18:00:47.701777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 77/175] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:47 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1559 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:47.706500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:47.707897 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:47.714848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.715343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.716289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.716889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.755749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:47.765384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ae803b0d-46ea-4b61-9a55-a3a59111cadc tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1558 microversion: 2.1 time: 0.217515 May 26 18:00:47.766183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 99/176] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:47 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:47.772804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:47.773632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:47.780515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.781089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.781942 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:47.782536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:47.907709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9bc33377-03ef-4660-9578-e19498d25b72 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139953 May 26 18:00:47.908412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 100/177] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:00:47 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:47.920971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:47.931659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-de7ac551-ad1f-4f87-85b1-da9acb0cdb79 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.228571 May 26 18:00:47.932360 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 78/178] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:47 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:48.783958 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:48.786290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:48.793861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:48.794316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:48.795162 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:48.795760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:48.950185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:48.950989 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:48.960046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:48.963138 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:48.964096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:48.966795 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:49.027313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:49.042025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3274f884-2121-42d3-b713-47debcbdaf78 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1558 microversion: 2.1 time: 0.262335 May 26 18:00:49.057177 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 101/179] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:48 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1558 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:49.172950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:49.191568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cb23435c-a881-4add-9a93-1efe845c65ec tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.246550 May 26 18:00:49.192240 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 79/180] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:48 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:49.632028 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-439bd750-e7d6-4c3e-ade7-a370d8017f53 req-9b9277e5-8602-4b24-8455-493da9057ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a948f2ab-1a7a-4cee-b600-643f1902a6ab", "tag": "2cb12eeb-27c0-467e-84f0-7f1df273a4a2"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:49.651275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-439bd750-e7d6-4c3e-ade7-a370d8017f53 req-9b9277e5-8602-4b24-8455-493da9057ad9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:49.652570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-439bd750-e7d6-4c3e-ade7-a370d8017f53 req-9b9277e5-8602-4b24-8455-493da9057ad9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:49.686930 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-439bd750-e7d6-4c3e-ade7-a370d8017f53 req-9b9277e5-8602-4b24-8455-493da9057ad9 service nova] Creating event network-changed:2cb12eeb-27c0-467e-84f0-7f1df273a4a2 for instance a948f2ab-1a7a-4cee-b600-643f1902a6ab on hv-cinder-83607 May 26 18:00:49.702482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-439bd750-e7d6-4c3e-ade7-a370d8017f53 req-9b9277e5-8602-4b24-8455-493da9057ad9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075216 May 26 18:00:49.703163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 102/181] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:50.059966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:50.061140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:50.079625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:50.079993 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:50.080772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:50.081202 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:50.109660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:50.209204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:50.209916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:50.235758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:50.236312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:50.237175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:50.237703 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:50.415333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:50.431072 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6063b008-4817-4e95-b5fe-907c644cb5b6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1558 microversion: 2.1 time: 0.369251 May 26 18:00:50.441177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 80/182] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:50 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1558 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:50.567109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:50.578222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ae494b5e-fa4e-450b-84ce-c64a8377f322 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.368341 May 26 18:00:50.581488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 103/183] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:50 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:51.448580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:51.450777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:51.460284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:51.461095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:51.462239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:51.463009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:51.539968 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:51.547954 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ebd378b0-47d0-4a22-b89c-f29365494f82 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1350 microversion: 2.1 time: 0.103703 May 26 18:00:51.548516 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 81/184] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:51 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:51.596157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:51.596788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:51.607266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:51.607715 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:51.608486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:51.608930 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:51.745205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-d7f0351a-0507-4f8d-84e9-f700eee07051 req-ac0a9338-50bc-4212-b1b2-70d2c08384fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471b2b61-2a00-4e45-b10a-a118ecaa546e", "name": "network-vif-deleted", "tag": "24ce99e8-5fa8-4285-860e-6ac3b637f96f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:51.760832 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d7f0351a-0507-4f8d-84e9-f700eee07051 req-ac0a9338-50bc-4212-b1b2-70d2c08384fe service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:51.761208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d7f0351a-0507-4f8d-84e9-f700eee07051 req-ac0a9338-50bc-4212-b1b2-70d2c08384fe service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:51.789504 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-d7f0351a-0507-4f8d-84e9-f700eee07051 req-ac0a9338-50bc-4212-b1b2-70d2c08384fe service nova] Creating event network-vif-deleted:24ce99e8-5fa8-4285-860e-6ac3b637f96f for instance 471b2b61-2a00-4e45-b10a-a118ecaa546e on hv-cinder-83607 May 26 18:00:51.798059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:51.811498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-d7f0351a-0507-4f8d-84e9-f700eee07051 req-ac0a9338-50bc-4212-b1b2-70d2c08384fe service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071233 May 26 18:00:51.818318 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-47838aa2-9f52-43c5-b48c-61637eacec93 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.225775 May 26 18:00:51.822704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 104/185] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:51 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:51.845589 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 82/186] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:00:52.565018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:52.565898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:52.574423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:52.574907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:52.575678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:52.576109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:52.609923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:52.610552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:52.610955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lazy-loading 'fault' on Instance uuid 471b2b61-2a00-4e45-b10a-a118ecaa546e {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:00:52.657742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b4d6be32e94ccd80f97aa8c93efbcc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd338e1d056d94062a703aa03ecb7edbb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:52.666865 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c55a0451-0e50-43cf-b990-626a823ebe0c tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 200 len: 1355 microversion: 2.1 time: 0.105631 May 26 18:00:52.668068 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 105/187] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:52 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:52.843027 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:52.844321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:52.852952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:52.853450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:52.854442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:52.854917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:53.169507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:53.177738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e6b17d2f-a853-47ed-9b75-3ae80204e237 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.346559 May 26 18:00:53.188089 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 83/188] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:52 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:53.684828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:53.685434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:53.692168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:53.692727 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:53.693625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:53.694155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:53.708911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] HTTP exception thrown: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Request method failure captured: May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e HTTP/1.1 May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AKjXvRHNu0gTonDccSKSfL5GgwsI5UxXAw5PFbu4IRaiowny2Hc7-nVW0zeEJbYnKcYM8kkt2ppN-f_I7ENwgyC-i_fvvlp4KzdtTk_ng314M_0JeQ9OXSL-M7DB7wIjh1SYBOdcIBsEMbb2VFiD0MxeJWmOqfnp8WBEwRyQkk5EI May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:00:53.713529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d338e1d056d94062a703aa03ecb7edbb", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 84b4d6be32e94ccd80f97aa8c93efbcc May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.714846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '471b2b61-2a00-4e45-b10a-a118ecaa546e'} May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:00:53.715528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.717844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:53.724656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Returning 404 to user: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:00:53.724656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f3892120-d845-430d-af0b-ded4b3baf2e6 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 404 len: 111 microversion: 2.1 time: 0.036539 May 26 18:00:53.724656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 106/189] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:53 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:00:53.856076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:53.857040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:53.864510 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:53.864965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:53.865736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:53.866174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:53.889470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] HTTP exception thrown: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Request method failure captured: May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e/os-volume_attachments HTTP/1.1 May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AKjXvRHNu0gTonDccSKSfL5GgwsI5UxXAw5PFbu4IRaiowny2Hc7-nVW0zeEJbYnKcYM8kkt2ppN-f_I7ENwgyC-i_fvvlp4KzdtTk_ng314M_0JeQ9OXSL-M7DB7wIjh1SYBOdcIBsEMbb2VFiD0MxeJWmOqfnp8WBEwRyQkk5EI May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:00:53.895191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d338e1d056d94062a703aa03ecb7edbb", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 84b4d6be32e94ccd80f97aa8c93efbcc May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.897135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'server_id': '471b2b61-2a00-4e45-b10a-a118ecaa546e'} May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:00:53.897988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:53.899239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:53.901107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Returning 404 to user: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:00:53.901107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c8935fe7-5809-4668-9545-d1863b01fd15 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046665 May 26 18:00:53.901107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 84/190] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:00:53 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:00:54.036642 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-302879141", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:00:54.089066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] validate_networks() for None {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:00:54.196445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:54.196961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:54.204005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:54.204646 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:54.205742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:54.206438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:54.634639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:54.649067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3c300133-27ef-4c1a-9742-132aee13a6f9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.457752 May 26 18:00:54.649982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 85/191] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:54 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:00:54.674257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:00:54.674784 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:00:54.675350 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:00:54.676870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:00:54.677594 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:00:54.688308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:54.689465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:54.690298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:54.690739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:54.717108 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Getting quotas for project afe657943fa44b88baffcf9fd273b4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:00:54.721492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Getting quotas for user 556aab8b6cb04d06bbf49250a456aaf0 and project afe657943fa44b88baffcf9fd273b4e9. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:00:54.737667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:00:54.740864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:00:54.865469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0b765a4f-8850-4188-b6af-4e381e4b58f1 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.833494 May 26 18:00:54.866338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 107/192] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:00:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:00:54.876308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-963c74cc-f317-4f9a-bb8e-0312196624e3 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:54.877677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-963c74cc-f317-4f9a-bb8e-0312196624e3 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:54.939953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-963c74cc-f317-4f9a-bb8e-0312196624e3 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:54.947721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-963c74cc-f317-4f9a-bb8e-0312196624e3 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1218 microversion: 2.1 time: 0.075377 May 26 18:00:54.948305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 86/193] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:54 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:55.307364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:55.307862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:55.315587 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.316042 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.317039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.317735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.332387 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] HTTP exception thrown: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Request method failure captured: May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e HTTP/1.1 May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AKjXvRHNu0gTonDccSKSfL5GgwsI5UxXAw5PFbu4IRaiowny2Hc7-nVW0zeEJbYnKcYM8kkt2ppN-f_I7ENwgyC-i_fvvlp4KzdtTk_ng314M_0JeQ9OXSL-M7DB7wIjh1SYBOdcIBsEMbb2VFiD0MxeJWmOqfnp8WBEwRyQkk5EI May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:00:55.335196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d338e1d056d94062a703aa03ecb7edbb", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 84b4d6be32e94ccd80f97aa8c93efbcc May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.336726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '471b2b61-2a00-4e45-b10a-a118ecaa546e'} May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:00:55.337444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.338485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:00:55.339796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Returning 404 to user: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:00:55.339796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-41a2b01e-9f25-4e5b-b040-8c6e4b9a1a42 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "DELETE /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 404 len: 111 microversion: 2.1 time: 0.033522 May 26 18:00:55.339796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 108/194] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:00:55 2022] DELETE /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:00:55.345384 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:55.345997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] [instance: 471b2b61-2a00-4e45-b10a-a118ecaa546e] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:55.354407 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.354891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.355674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.356289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.371518 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] HTTP exception thrown: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Request method failure captured: May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e HTTP/1.1 May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AKjXvRHNu0gTonDccSKSfL5GgwsI5UxXAw5PFbu4IRaiowny2Hc7-nVW0zeEJbYnKcYM8kkt2ppN-f_I7ENwgyC-i_fvvlp4KzdtTk_ng314M_0JeQ9OXSL-M7DB7wIjh1SYBOdcIBsEMbb2VFiD0MxeJWmOqfnp8WBEwRyQkk5EI May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:00:55.373716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d338e1d056d94062a703aa03ecb7edbb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d338e1d056d94062a703aa03ecb7edbb", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: d338e1d056d94062a703aa03ecb7edbb May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-DeleteServersTestJSON-79187831 May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 84b4d6be32e94ccd80f97aa8c93efbcc May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-DeleteServersTestJSON-79187831-project May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.375457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '471b2b61-2a00-4e45-b10a-a118ecaa546e'} May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:00:55.376156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. May 26 18:00:55.377166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:00:55.378078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] Returning 404 to user: Instance 471b2b61-2a00-4e45-b10a-a118ecaa546e could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:00:55.378078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-894ed72a-3474-4c5c-a0ab-afbaae1a07f7 tempest-DeleteServersTestJSON-79187831 tempest-DeleteServersTestJSON-79187831-project] 10.222.0.121 "GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e" status: 404 len: 111 microversion: 2.1 time: 0.033629 May 26 18:00:55.378078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 87/195] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:55 2022] GET /compute/v2.1/servers/471b2b61-2a00-4e45-b10a-a118ecaa546e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:00:55.667969 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:55.668584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:55.674876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.675327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.676085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:55.677303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:55.937944 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:55.948365 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f10c0360-1357-460e-a7dd-52b96686d1ab tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.284736 May 26 18:00:55.948938 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 109/196] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:55 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:55.964711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cd5ab603-e25f-45b1-9834-0ef9c7e18af2 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:55.965523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cd5ab603-e25f-45b1-9834-0ef9c7e18af2 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:56.040004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cd5ab603-e25f-45b1-9834-0ef9c7e18af2 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:56.047839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cd5ab603-e25f-45b1-9834-0ef9c7e18af2 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1218 microversion: 2.1 time: 0.086798 May 26 18:00:56.048770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 88/197] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:55 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:56.966739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:56.967335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:56.973272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:56.973726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:56.974497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:56.974964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:57.072698 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:57.073321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:57.088010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:57.089687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:57.090506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:57.093378 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:57.217716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:57.221148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:57.231063 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eae5239f-1da9-4045-a847-44f70f42650b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.268343 May 26 18:00:57.236336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-649e7dfa-7a6b-4f96-86b6-7acddf6017f8 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1270 microversion: 2.1 time: 0.173106 May 26 18:00:57.238698 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 89/199] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:57 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:57.239546 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 110/199] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:56 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:58.248695 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:58.249202 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:58.260837 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:58.261611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:58.264011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:00:58.273644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:58.274186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:58.276338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:58.277575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:58.278408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:58.278775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:58.278905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:58.279724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:58.424130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:58.438003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7d28848f-3f28-4416-a72c-72e6f98584df tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1288 microversion: 2.1 time: 0.181532 May 26 18:00:58.438852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 111/200] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:58 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:58.540718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:58.550773 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f3ff6788-c06b-483e-a28e-24de539269da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.305861 May 26 18:00:58.552978 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 90/201] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:58 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:59.460720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:59.460720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:59.477900 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:59.478419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:59.481707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:59.482341 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:59.570014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:00:59.570766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:00:59.579559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:59.580163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:59.581564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:00:59.582014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:00:59.703592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:59.717253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bcb3099f-540f-4023-ab64-f7254fed4bbf tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.263499 May 26 18:00:59.719488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 112/202] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:59 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:00:59.760829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:00:59.768740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4b072db6-d11b-46da-a5e0-2ee848b95b26 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.203133 May 26 18:00:59.769322 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 91/203] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:00:59 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:00.413737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-c04058fb-88ff-4d80-a12a-ce7cfdb37b2a req-51caa75e-eb98-4c4d-a1fd-612eb0ce9f3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a31232-14c4-433b-8457-2a521a56eafa", "tag": "d60ca897-1106-4713-84a5-37a26dc0c1c1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:00.427155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c04058fb-88ff-4d80-a12a-ce7cfdb37b2a req-51caa75e-eb98-4c4d-a1fd-612eb0ce9f3a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:00.427155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c04058fb-88ff-4d80-a12a-ce7cfdb37b2a req-51caa75e-eb98-4c4d-a1fd-612eb0ce9f3a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:00.440029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-c04058fb-88ff-4d80-a12a-ce7cfdb37b2a req-51caa75e-eb98-4c4d-a1fd-612eb0ce9f3a service nova] Creating event network-changed:d60ca897-1106-4713-84a5-37a26dc0c1c1 for instance 78a31232-14c4-433b-8457-2a521a56eafa on hv-cinder-83607 May 26 18:01:00.446529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-c04058fb-88ff-4d80-a12a-ce7cfdb37b2a req-51caa75e-eb98-4c4d-a1fd-612eb0ce9f3a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036992 May 26 18:01:00.447474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 113/204] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:00.737450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:00.738062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:00.745553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:00.746010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:00.747034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:00.748126 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:00.787950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:00.788648 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:00.795562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:00.796451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:00.796964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:00.797408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:00.939055 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:00.947752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b68c96ea-d66b-4890-99af-b7d397ccffff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.214044 May 26 18:01:00.948685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 92/205] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:00 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:01.015030 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:01.023719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9880e02d-383b-4eec-be9d-cb19b8099a35 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.240515 May 26 18:01:01.024432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 114/206] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:00 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:01.964920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:01.965527 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:01.980139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:01.980139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:01.980139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:01.980139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:01.986619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-acfc5c73-7cb8-40d5-bced-cf2feba32bda tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b899af430>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:02.045091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-acfc5c73-7cb8-40d5-bced-cf2feba32bda tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/0e6eac0a-b8ad-4fb0-88d6-dcc8f16162b1" status: 200 len: 350 microversion: 2.1 time: 0.062634 May 26 18:01:02.045663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 115/207] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:01:01 2022] GET /compute/v2.1/os-volumes/0e6eac0a-b8ad-4fb0-88d6-dcc8f16162b1 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:02.050326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:02.050994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:02.057688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:02.058378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:02.059608 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:02.060206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:02.171229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:02.184061 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-527d628a-3008-4237-8f80-06b1a36d5351 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.223473 May 26 18:01:02.185728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 93/208] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:01 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:02.236728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:02.246677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8c7e8aac-db09-47b1-a9d0-24efde148f5c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.199721 May 26 18:01:02.247297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 116/209] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:02 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:03.201745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:03.202365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:03.209114 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:03.209566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:03.210339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:03.210781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:03.264706 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:03.265370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:03.272064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:03.275674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:03.275674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:03.275674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:03.412630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:03.420533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7d9199c7-6f11-4c5a-9c21-cd6f3a43157f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.222540 May 26 18:01:03.421383 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 94/210] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:03 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:03.461612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:03.469179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-92755dca-3467-41d5-90e8-209eba8cdba6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.208389 May 26 18:01:03.469739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 117/211] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:03 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:04.437305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:04.437922 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:04.445465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:04.445923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:04.447136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:04.447591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:04.487145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:04.489110 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:04.497517 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:04.498019 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:04.498999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:04.499436 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:04.687850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:04.697721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:04.700022 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2a25e974-9d79-456f-8fe8-1da6cdacff56 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.266451 May 26 18:01:04.706228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:04.706228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:04.709148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c8c39f3d-083c-417a-9868-7f92000ac8e9 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.226637 May 26 18:01:04.709733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 118/212] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:04 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:04.710268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 95/213] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:04 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:04.896736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2f9f148d-cb8d-4829-a7d6-e3a66a562813 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b89993f70>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:04.903339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:04.948125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2f9f148d-cb8d-4829-a7d6-e3a66a562813 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/339f6683-7b04-49fa-a044-5d22275115d2" status: 200 len: 351 microversion: 2.1 time: 0.055825 May 26 18:01:04.949275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 119/214] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:01:04 2022] GET /compute/v2.1/os-volumes/339f6683-7b04-49fa-a044-5d22275115d2 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:05.717441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:05.718046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:05.727517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:05.727517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:05.727517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:05.727517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:05.728163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:05.728916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:05.735697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:05.736154 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:05.737072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:05.737378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:05.953712 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:05.966055 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8ffe830b-e22c-43a6-8aa4-bd3c976a6407 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.252175 May 26 18:01:05.966685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 96/215] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:05 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:05.968616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:05.978107 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f18177e7-bd26-475f-be27-9d5372ccee3f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.255878 May 26 18:01:05.978691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 120/216] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:05 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:06.983916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:06.984475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:06.986391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=4 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:06.992752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:06.993198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:06.993971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:06.994485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:06.996290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:06.996919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:07.003328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:07.003808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:07.004681 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:07.005154 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:07.218209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:07.222013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:07.228775 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-af9883cf-8508-43c7-8a71-9f3b81fea1e0 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.248660 May 26 18:01:07.230449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-306365cc-589a-455f-886f-c2f3a7cacbd2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.238001 May 26 18:01:07.239174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 97/217] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:06 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:07.242127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 121/218] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:06 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:07.706562 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e9635b8c-95b0-44a6-b6c2-da945eb60741 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b8a4264c0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:07.757209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e9635b8c-95b0-44a6-b6c2-da945eb60741 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/80a65858-178f-4731-9bec-c62cd6d3d22a" status: 200 len: 351 microversion: 2.1 time: 0.054993 May 26 18:01:07.757925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 98/219] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:01:07 2022] GET /compute/v2.1/os-volumes/80a65858-178f-4731-9bec-c62cd6d3d22a => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:07.769334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fef1fd47-57f1-4b34-a916-3d14667cf0b3 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b899659d0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:07.800632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-ec6363e7-38a1-4d81-8d4c-b5258c602850 req-5312421d-a209-4dc4-9986-c0e300ad5dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a31232-14c4-433b-8457-2a521a56eafa", "name": "network-vif-plugged", "status": "completed", "tag": "d60ca897-1106-4713-84a5-37a26dc0c1c1"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:07.813490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ec6363e7-38a1-4d81-8d4c-b5258c602850 req-5312421d-a209-4dc4-9986-c0e300ad5dd9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:07.814304 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ec6363e7-38a1-4d81-8d4c-b5258c602850 req-5312421d-a209-4dc4-9986-c0e300ad5dd9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:07.827487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-ec6363e7-38a1-4d81-8d4c-b5258c602850 req-5312421d-a209-4dc4-9986-c0e300ad5dd9 service nova] Creating event network-vif-plugged:d60ca897-1106-4713-84a5-37a26dc0c1c1 for instance 78a31232-14c4-433b-8457-2a521a56eafa on hv-cinder-83607 May 26 18:01:07.832577 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-ec6363e7-38a1-4d81-8d4c-b5258c602850 req-5312421d-a209-4dc4-9986-c0e300ad5dd9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036950 May 26 18:01:07.833235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 99/220] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:01:07.861874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fef1fd47-57f1-4b34-a916-3d14667cf0b3 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096866 May 26 18:01:07.869248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 122/221] 10.222.0.121 () {58 vars in 1138 bytes} [Thu May 26 18:01:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:07.876969 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-55b6de2c-2318-4c06-b8c8-fd350f5ce9e0 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b8a2cf550>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:07.983596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-55b6de2c-2318-4c06-b8c8-fd350f5ce9e0 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.110896 May 26 18:01:07.984165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 100/222] 10.222.0.121 () {58 vars in 1153 bytes} [Thu May 26 18:01:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:07.996852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6d465be6-62f6-4dff-a061-9f494adb2bdf tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b89ba9940>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.081496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6d465be6-62f6-4dff-a061-9f494adb2bdf tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.088580 May 26 18:01:08.082092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 123/223] 10.222.0.121 () {58 vars in 1138 bytes} [Thu May 26 18:01:07 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:08.094245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3c13d5af-a874-4a85-85e8-5a8b1f0af8f7 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b8a227790>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.179081 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3c13d5af-a874-4a85-85e8-5a8b1f0af8f7 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089034 May 26 18:01:08.179653 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 101/224] 10.222.0.121 () {58 vars in 1171 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:08.191452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-94dfb37d-31f0-4aa6-979a-5805737add94 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b899afdc0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.246991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.247735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:08.254420 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:08.255735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:08.258925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:08.259701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:08.279299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-94dfb37d-31f0-4aa6-979a-5805737add94 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091715 May 26 18:01:08.280575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 124/225] 10.222.0.121 () {58 vars in 1174 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:08.287499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.288779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:08.301103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:08.302082 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:08.303169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:08.303735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:08.478320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:08.489010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-eda3b1a2-2fdc-4232-b30a-e281cdb7cc80 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.245872 May 26 18:01:08.489657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 102/226] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:08.490148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:08.495534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5050c3b7-548e-4ab5-a3cb-eddce73e12cd tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b8a341940>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.498254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dbfb20e6-aa1b-4eb2-9b27-1391cd86312d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1524 microversion: 2.1 time: 0.216312 May 26 18:01:08.498767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 125/227] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1524 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:08.578012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5050c3b7-548e-4ab5-a3cb-eddce73e12cd tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087036 May 26 18:01:08.578681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 103/228] 10.222.0.121 () {58 vars in 1159 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:08.590679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-725af4ba-3783-47fc-a641-01674cb8a319 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b899655e0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.673321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-725af4ba-3783-47fc-a641-01674cb8a319 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086650 May 26 18:01:08.673987 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 126/229] 10.222.0.121 () {58 vars in 1192 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:08.686366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0a4066cf-eee5-4e6c-b443-9d105afff864 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] Calling method '.version_select at 0x7f4b8a227c10>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:08.767374 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0a4066cf-eee5-4e6c-b443-9d105afff864 tempest-VolumesTestJSON-1634841428 tempest-VolumesTestJSON-1634841428-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084932 May 26 18:01:08.767945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 104/230] 10.222.0.121 () {58 vars in 1159 bytes} [Thu May 26 18:01:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:09.506438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:09.507067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:09.513705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.514085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.514873 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.515355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.517155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:09.517827 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:09.525642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.526091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.526925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.527394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.717565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:09.721396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:09.730646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1c5d6bb9-a5ad-49ff-a242-b0bda3004c33 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.227839 May 26 18:01:09.731743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 127/231] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:09 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:09.734346 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e80d7be6-9915-4426-abb4-72c7e23717a6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1504 microversion: 2.1 time: 0.221322 May 26 18:01:09.740509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 105/232] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:09 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:09.751381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:09.751990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:09.759423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.760158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.761415 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:09.762150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:09.900851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:09.908641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1c9ffdcf-e52c-4ed7-ade6-1b3861ec138f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1519 microversion: 2.1 time: 0.160991 May 26 18:01:09.909212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 128/233] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:09 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:10.750352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:10.750974 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:10.758653 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:10.759132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:10.759899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:10.760371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:10.777106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:10.901175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:10.909169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ad6ee499-ef31-4373-93d5-e500de4bc798 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.162540 May 26 18:01:10.909975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 106/234] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:10 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:11.929052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:11.929655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:11.936109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:11.936563 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:11.937329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:11.937767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:12.073260 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:12.080673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-18f072ae-01c3-4c41-ac05-94f0215f20ff tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.155468 May 26 18:01:12.081240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 129/235] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:11 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:13.099089 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:13.099689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:13.107420 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:13.107870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:13.108639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:13.109071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:13.243466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:13.250991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-82f92984-74db-43ee-acf2-4273ee85b3ac tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.155851 May 26 18:01:13.251565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 107/236] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:13 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:14.268869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:14.269469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:14.276601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:14.277048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:14.277804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:14.278234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:14.409949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:14.417763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4b460862-6404-4a0a-8c2d-63d06bbdd089 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.152686 May 26 18:01:14.418346 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 130/237] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:14 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:15.435058 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:15.435702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:15.438007 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:15.442743 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:15.443242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:15.443996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:15.444427 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:15.581706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:15.590609 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cc020c92-280c-47fb-ace7-7a80b02c28ee tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.159751 May 26 18:01:15.591425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 108/238] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:15 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:16.608354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:16.608974 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:16.615191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:16.615676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:16.616445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:16.616874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:16.748529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:16.755984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-78a4d02b-6a51-4a33-9af3-854545a898b9 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1318 microversion: 2.1 time: 0.152010 May 26 18:01:16.756558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 131/239] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:16 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:17.773579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:17.774173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:17.782226 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:17.782685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:17.783485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:17.783925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:17.922008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:17.929439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d8a681d4-1183-4afb-8017-74e8ae7e9ef7 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1467 microversion: 2.1 time: 0.159815 May 26 18:01:17.930008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 109/240] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:17 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1467 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:17.969695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:17.970196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:17.976380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:17.976835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:17.977596 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:17.978036 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.004694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:01:18.429277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-40b61305-a4b9-43cf-941d-42cbc41eda3f tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "DELETE /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 204 len: 0 microversion: 2.1 time: 0.462798 May 26 18:01:18.429999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 132/241] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:01:17 2022] DELETE /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:01:18.439231 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.439844 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:18.446404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.446952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.447637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.448723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.450763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:18.451959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:18.457964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.458640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.459538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.459984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.484924 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'flavor' on Instance uuid 25b24c05-9d81-4199-8295-d51b05cb919f {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:01:18.588643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:18.596652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2e7b9846-23ff-448a-9320-150c24d25f05 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1473 microversion: 2.1 time: 0.161353 May 26 18:01:18.597225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 110/242] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:18.809247 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3209f90c-51e4-4744-beae-0e41994d5c11 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/action" status: 200 len: 32 microversion: 2.1 time: 0.356797 May 26 18:01:18.809247 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 133/243] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:01:18 2022] POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 18:01:18.813919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:18.814543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:18.821999 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.822517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.823423 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:18.824001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:18.983559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:18.991644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-350b84aa-f912-4bb8-a570-3d055baf2c43 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.181383 May 26 18:01:18.992221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 111/244] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:18 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:19.615144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:19.615830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:19.622309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:19.622756 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:19.623582 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:19.631856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:19.772712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:19.780498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ef653f61-e5ac-4aeb-a3e1-8ce3af58a826 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1473 microversion: 2.1 time: 0.169641 May 26 18:01:19.785094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 134/245] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:19 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1473 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:20.011807 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:20.013796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:20.024271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:20.024271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:20.024271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:20.024271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:20.176768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:20.184438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b8c28928-2b7f-422c-b66b-bdd4918e9e4c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.178685 May 26 18:01:20.185013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 112/246] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:20 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:20.800268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:20.800911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:20.807656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:20.808124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:20.809135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:20.809597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:20.971145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:20.978675 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fb479159-7772-484d-8f56-62a6e05355aa tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1473 microversion: 2.1 time: 0.182148 May 26 18:01:20.979948 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 135/247] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:20 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1473 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:21.202157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:21.203833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:21.210803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:21.211537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:21.212375 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:21.212981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:21.396546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:21.405173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-333a5446-73c5-466b-9de2-9a0e87f24877 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.207439 May 26 18:01:21.406099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 113/248] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:21 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:21.601629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-52871124-56c4-4df9-ac72-6fb9b2f41872 req-78647f15-9284-406f-87d5-4d6047181d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a31232-14c4-433b-8457-2a521a56eafa", "name": "network-vif-deleted", "tag": "d60ca897-1106-4713-84a5-37a26dc0c1c1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:21.612462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-52871124-56c4-4df9-ac72-6fb9b2f41872 req-78647f15-9284-406f-87d5-4d6047181d51 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:21.613381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-52871124-56c4-4df9-ac72-6fb9b2f41872 req-78647f15-9284-406f-87d5-4d6047181d51 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:21.625303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-52871124-56c4-4df9-ac72-6fb9b2f41872 req-78647f15-9284-406f-87d5-4d6047181d51 service nova] Creating event network-vif-deleted:d60ca897-1106-4713-84a5-37a26dc0c1c1 for instance 78a31232-14c4-433b-8457-2a521a56eafa on hv-cinder-83607 May 26 18:01:21.630288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-52871124-56c4-4df9-ac72-6fb9b2f41872 req-78647f15-9284-406f-87d5-4d6047181d51 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 May 26 18:01:21.631000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 136/249] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:22.008521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:22.008521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:22.015663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.016514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.017877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.018648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.080649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.081933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.082977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lazy-loading 'fault' on Instance uuid 78a31232-14c4-433b-8457-2a521a56eafa {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:01:22.145387 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '556aab8b6cb04d06bbf49250a456aaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe657943fa44b88baffcf9fd273b4e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:22.159356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-58d15104-cfe1-4057-81b1-52d855db478b tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 200 len: 1308 microversion: 2.1 time: 0.165682 May 26 18:01:22.160631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 114/250] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:21 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:22.422772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:22.423495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:22.430088 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.430544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.439779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:22.440236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:22.476770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:22.674353 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:22.688852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4948b30c-732c-4518-a067-858daab138a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.270294 May 26 18:01:22.689632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 137/251] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:22 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:23.180392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:23.180950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] [instance: 78a31232-14c4-433b-8457-2a521a56eafa] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:23.187966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.188428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:23.189215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.189656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:23.205253 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] HTTP exception thrown: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Request method failure captured: May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa HTTP/1.1 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8BSr2kkXfIjOAgGfRx5l_1zpc5jgzE2JiLPJ63E1_D_2opE_I91pRKjz4mqd0LxQprtCrrTX-SQqjlFWVNDWEgz8pi1IDBgXKHY1D6I0LCinRb6pRZanzNRuXpwyNwQNTmQOODtzq_8L9SpNVHEptUTu9yWIg-i_ThL0p8GdvPoZpQ May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: afe657943fa44b88baffcf9fd273b4e9 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-VolumesNegativeTest-1634740159 May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:01:23.206940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/afe657943fa44b88baffcf9fd273b4e9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/afe657943fa44b88baffcf9fd273b4e9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/afe657943fa44b88baffcf9fd273b4e9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_afe657943fa44b88baffcf9fd273b4e9", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-VolumesNegativeTest-1634740159 May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: afe657943fa44b88baffcf9fd273b4e9 May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-VolumesNegativeTest-1634740159 May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-VolumesNegativeTest-1634740159-project May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 556aab8b6cb04d06bbf49250a456aaf0 May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-VolumesNegativeTest-1634740159-project May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. May 26 18:01:23.208798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '78a31232-14c4-433b-8457-2a521a56eafa'} May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:23.209766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. May 26 18:01:23.211144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:23.212463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] Returning 404 to user: Instance 78a31232-14c4-433b-8457-2a521a56eafa could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:23.212463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fd34e4ff-874d-46c3-aa64-a3a227e37e47 tempest-VolumesNegativeTest-1634740159 tempest-VolumesNegativeTest-1634740159-project] 10.222.0.121 "GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa" status: 404 len: 111 microversion: 2.1 time: 0.031844 May 26 18:01:23.212463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 115/252] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:23 2022] GET /compute/v2.1/servers/78a31232-14c4-433b-8457-2a521a56eafa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:01:23.709425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:23.710119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:23.717447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.717899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:23.718898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:23.719339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:23.936607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:23.967445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a3e7d004-5b1d-4529-b3b5-54e3dc7990d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.261647 May 26 18:01:23.975508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 138/253] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:23 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:24.038905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-da33c76a-1fbe-4831-81d4-7c660668e9b0 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Action: 'create', calling method: .version_select at 0x7f4b8a34ddc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2023772773", "metadata": {"Type": "work"}}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-da33c76a-1fbe-4831-81d4-7c660668e9b0 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 122 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:01:24.048774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2023772773", "metadata": {"Type": "work"}}} May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: May 26 18:01:24.051558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2023772773', 'metadata': {'Type': 'work'}}}} May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise error May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi '#$%' May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.053070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:01:24.055956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:01:24.058267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 18:01:24.058267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.058267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-da33c76a-1fbe-4831-81d4-7c660668e9b0 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.058267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-da33c76a-1fbe-4831-81d4-7c660668e9b0 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.254469 May 26 18:01:24.058267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 116/254] 10.222.0.121 () {60 vars in 1160 bytes} [Thu May 26 18:01:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:01:24.061284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b4b5f31b-98c9-4af5-a539-25a137ac0831 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Action: 'create', calling method: .version_select at 0x7f4b8997e160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-700279683", "metadata": {"Type": "work"}}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b4b5f31b-98c9-4af5-a539-25a137ac0831 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 119 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:01:24.063461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-700279683", "metadata": {"Type": "work"}}} May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 18:01:24.064787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-700279683', 'metadata': {'Type': 'work'}}}} May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise error May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi '0' May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.065611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:01:24.067839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:01:24.068956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 18:01:24.068956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.068956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b4b5f31b-98c9-4af5-a539-25a137ac0831 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.068956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b4b5f31b-98c9-4af5-a539-25a137ac0831 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009670 May 26 18:01:24.068956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 139/255] 10.222.0.121 () {60 vars in 1160 bytes} [Thu May 26 18:01:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 18:01:24.086837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6b112a29-989f-494a-928f-821515a12718 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Action: 'create', calling method: .version_select at 0x7f4b8a201dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-658481243", "metadata": {"Type": "work"}}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6b112a29-989f-494a-928f-821515a12718 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 118 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:01:24.093587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-658481243", "metadata": {"Type": "work"}}} May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: May 26 18:01:24.095177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-658481243', 'metadata': {'Type': 'work'}}}} May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise error May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi '' May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.096216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 18:01:24.097605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 18:01:24.098885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 18:01:24.098885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.098885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6b112a29-989f-494a-928f-821515a12718 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.098885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6b112a29-989f-494a-928f-821515a12718 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015962 May 26 18:01:24.109957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ef807103-38da-4c70-84f9-5e4d2ad9c974 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Calling method '.version_select at 0x7f4b899650d0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:24.112301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 117/256] 10.222.0.121 () {60 vars in 1160 bytes} [Thu May 26 18:01:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:01:24.149077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-ef807103-38da-4c70-84f9-5e4d2ad9c974 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] HTTP exception thrown: Volume tempest-invalid-748038046 could not be found. May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ef807103-38da-4c70-84f9-5e4d2ad9c974 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-748038046 HTTP/1.1 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:01:24.151994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Volume tempest-invalid-748038046 could not be found. May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'tempest-invalid-748038046'} May 26 18:01:24.154326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-748038046 could not be found. (HTTP 404) (Request-ID: req-a5ff5850-379c-428d-8a5d-f0dbdd7b06db) May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.155592 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:01:24.157127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-748038046 could not be found. May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:01:24.158369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-748038046 could not be found. May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-748038046 could not be found. May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ef807103-38da-4c70-84f9-5e4d2ad9c974 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 404 to user: Volume tempest-invalid-748038046 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.159764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ef807103-38da-4c70-84f9-5e4d2ad9c974 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/tempest-invalid-748038046" status: 404 len: 98 microversion: 2.1 time: 0.052733 May 26 18:01:24.165796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8a7f2786-5353-4910-a063-37bc3f0e82e9 tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004127 May 26 18:01:24.167071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 118/258] 10.222.0.121 () {58 vars in 1144 bytes} [Thu May 26 18:01:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:01:24.174659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 140/258] 10.222.0.121 () {58 vars in 1219 bytes} [Thu May 26 18:01:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-748038046 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 18:01:24.182646 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e2af5ebf-a140-4a41-8fc3-3bee9cfde07f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003881 May 26 18:01:24.184434 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 119/259] 10.222.0.121 () {58 vars in 1141 bytes} [Thu May 26 18:01:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 18:01:24.193456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-630a7fb3-067c-4b0b-b3d5-1dbc0537db5f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Calling method '.version_select at 0x7f4b8997ee50>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:24.223656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-630a7fb3-067c-4b0b-b3d5-1dbc0537db5f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] HTTP exception thrown: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-630a7fb3-067c-4b0b-b3d5-1dbc0537db5f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/os-volumes/5f77a529-81c5-44a2-8b90-6f068f1ab296 HTTP/1.1 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:01:24.225829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '5f77a529-81c5-44a2-8b90-6f068f1ab296'} May 26 18:01:24.227412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. (HTTP 404) (Request-ID: req-ccea1ef5-d251-42cb-b1bc-eb0171af36b7) May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.228782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 18:01:24.231061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 18:01:24.232371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-630a7fb3-067c-4b0b-b3d5-1dbc0537db5f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 404 to user: Volume 5f77a529-81c5-44a2-8b90-6f068f1ab296 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-630a7fb3-067c-4b0b-b3d5-1dbc0537db5f tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/5f77a529-81c5-44a2-8b90-6f068f1ab296" status: 404 len: 109 microversion: 2.1 time: 0.040781 May 26 18:01:24.233550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 141/260] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:01:24 2022] DELETE /compute/v2.1/os-volumes/5f77a529-81c5-44a2-8b90-6f068f1ab296 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:01:24.241672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b781bc45-96bc-471a-96ec-9bf4d4d5a31b tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Calling method '.version_select at 0x7f4b8a2308b0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:24.273580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-b781bc45-96bc-471a-96ec-9bf4d4d5a31b tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] HTTP exception thrown: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b781bc45-96bc-471a-96ec-9bf4d4d5a31b tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Request method failure captured: May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/os-volumes/384e1c80-bbbd-40a6-84d1-d2142ada0c7d HTTP/1.1 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8BzUsABizG1nOogWnqX58GM2ulkxi5raw2dhCtcjegcOr6zBXc3N0mVZ4lAf6qHeJ0TOItIreY1UKtxRe2qEBcBQ5-HmRPa8MWQxXSTjghNZl_1DcTHEaUPsyYVMuw_m4CCIjAUyGruadZgsl8uArDzE6gcoYwoeYEubKk61goSZ1s May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:01:24.277732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/588c313eba2e4469bc1206ab2794a2c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_588c313eba2e4469bc1206ab2794a2c2", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 588c313eba2e4469bc1206ab2794a2c2 May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-VolumesNegativeTest-1344540443 May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 841c59c497444d23819c386349fc4e3d May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-VolumesNegativeTest-1344540443-project May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '384e1c80-bbbd-40a6-84d1-d2142ada0c7d'} May 26 18:01:24.279062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. (HTTP 404) (Request-ID: req-3dfce066-21fe-43ff-b775-f98211d3f8b9) May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.279838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:01:24.281557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:01:24.282867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b781bc45-96bc-471a-96ec-9bf4d4d5a31b tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] Returning 404 to user: Volume 384e1c80-bbbd-40a6-84d1-d2142ada0c7d could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b781bc45-96bc-471a-96ec-9bf4d4d5a31b tempest-VolumesNegativeTest-1344540443 tempest-VolumesNegativeTest-1344540443-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/384e1c80-bbbd-40a6-84d1-d2142ada0c7d" status: 404 len: 109 microversion: 2.1 time: 0.041989 May 26 18:01:24.284052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 120/261] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:01:24 2022] GET /compute/v2.1/os-volumes/384e1c80-bbbd-40a6-84d1-d2142ada0c7d => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:01:24.986998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:24.987879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:25.017850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:25.022950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:25.022950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:25.022950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:25.202576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:25.211352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ca37a538-4282-4f37-bc1b-6926dee6a024 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.229064 May 26 18:01:25.221191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 142/262] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:24 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:26.233351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:26.234541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:26.251167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:26.251167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:26.251167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:26.251167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:26.591781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:26.599363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7ad21ff1-5974-4875-9f8b-46206c1245ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.373494 May 26 18:01:26.599934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 121/263] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:26 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:27.621733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:27.621733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:27.628355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:27.629161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:27.630160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:27.630850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:27.855024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:27.862628 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c235d993-1f33-48c3-ad53-357235078afe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.247885 May 26 18:01:27.863273 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 143/264] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:27 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:28.879452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:28.880069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:28.891826 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:28.892469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:28.893590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:28.894532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:29.063465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:29.072098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9d35f877-0ab2-4c30-b576-d97fedfe85d6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.196692 May 26 18:01:29.080539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 122/265] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:28 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:30.094971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:30.096337 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:30.103263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:30.103801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:30.104896 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:30.105737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:30.254447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:30.263230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-93557a8a-8720-4393-8e7e-f4c4d1241104 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.172663 May 26 18:01:30.263678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 144/266] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:30 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:31.280037 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:31.281281 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:31.288421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:31.289111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:31.290200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:31.291107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:31.442252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:31.451703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e1995074-377c-4d00-af11-12a9419c7fed tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.175735 May 26 18:01:31.452544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 123/267] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:31 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:32.470664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:32.471852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:32.478973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:32.494223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:32.494566 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:32.499787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:32.500285 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:32.650070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:32.659167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-79fcd299-e5b5-4bb7-89de-77cffd5d5872 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.193645 May 26 18:01:32.660418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 145/268] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:32 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:32.719710 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-932714013", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "networks": [{"uuid": "28b216ad-c369-43b9-b3a0-26ffaee2711e"}]}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:32.778964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] validate_networks() for [('28b216ad-c369-43b9-b3a0-26ffaee2711e', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:33.192216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:33.192636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:33.193109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:33.193515 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:33.193925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:33.203948 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:33.204396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:33.205278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:33.207465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:33.226121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Getting quotas for project e358a1e391cf4ea18f18b10ed3585a91. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:33.232544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Getting quotas for user 9dc1b321e70f42e2be177e161486f997 and project e358a1e391cf4ea18f18b10ed3585a91. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:33.245141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:33.247820 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:33.454500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6350eedb-f9a7-467c-b370-3c7f0f8a8974 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.738667 May 26 18:01:33.455530 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 124/269] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:01:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:01:33.465384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d4ac6c3c-ae05-4f7a-bba3-51a51508b5c9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:33.466002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d4ac6c3c-ae05-4f7a-bba3-51a51508b5c9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:33.532125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d4ac6c3c-ae05-4f7a-bba3-51a51508b5c9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:33.540124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d4ac6c3c-ae05-4f7a-bba3-51a51508b5c9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1217 microversion: 2.1 time: 0.078698 May 26 18:01:33.540916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 146/270] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:33 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:33.684363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:33.685024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:33.695938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:33.696391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:33.697169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:33.697605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:33.860436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:33.872541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-27e5748e-25c6-44d3-9eb9-edaceaf64a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.194433 May 26 18:01:33.873367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 125/271] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:33 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:34.558039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0fad33ee-9678-4efc-a2a9-b77e9628c22a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:34.563165 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0fad33ee-9678-4efc-a2a9-b77e9628c22a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:34.617006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0fad33ee-9678-4efc-a2a9-b77e9628c22a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:34.625897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0fad33ee-9678-4efc-a2a9-b77e9628c22a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1217 microversion: 2.1 time: 0.072065 May 26 18:01:34.626572 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 147/272] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:34 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:34.891261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:34.891874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:34.898807 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.909308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:34.909308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:34.909308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:35.040863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.048584 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-44891458-70dc-4ca2-bbfe-c5364c96a7fd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.162390 May 26 18:01:35.049148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 126/273] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:34 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:35.644321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:35.644928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:35.651022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:35.652446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:35.653137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:35.654582 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:35.713240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:35.721521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-85ae2705-5889-49b4-9a35-67518f349da4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1221 microversion: 2.1 time: 0.081033 May 26 18:01:35.722092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 148/274] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:35 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:36.065700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:36.066544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:36.075165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.075621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.076427 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.076864 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.212386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:36.220353 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cc248112-8f03-42d8-824e-474d8efca24d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.158458 May 26 18:01:36.221064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 127/275] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:36 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:36.739143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:36.739732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:36.746204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.746769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.747586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:36.748027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:36.812035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:36.819517 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-af3e1d3f-7dcf-49c4-b488-7394ab760b4d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1221 microversion: 2.1 time: 0.084267 May 26 18:01:36.820085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 149/276] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:36 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:37.237602 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:37.238221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:37.245029 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:37.245473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:37.247281 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:37.247891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:37.391619 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:37.399547 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-08e3ad06-5fdd-4963-aafd-36778b4b381a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.165747 May 26 18:01:37.400241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 128/277] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:37 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:37.836911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:37.837527 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:37.844398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:37.844779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:37.845552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:37.845989 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:37.906184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:37.913713 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-90a27d40-3ff0-4ef9-9e4f-17abcceb4495 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1221 microversion: 2.1 time: 0.080686 May 26 18:01:37.914423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 150/278] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:37 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:38.417745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:38.418849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:38.425368 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.425816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:38.426569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.427035 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:38.429557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:38.566267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:38.574776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-868da96c-bea6-4718-a2a8-9bfdcd31857f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.160641 May 26 18:01:38.575644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 129/279] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:38 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:38.931629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:38.932243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:38.939165 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.939614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:38.940402 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:38.940834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.005157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:39.015063 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4db5d802-fade-43b8-92c5-53d896accb35 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1221 microversion: 2.1 time: 0.087203 May 26 18:01:39.015649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 151/280] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:38 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:39.593082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:39.593688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:39.601455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.601899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.602755 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.603267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.750421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:39.759170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-74807dbc-b4ff-4c9b-883e-9c4a748ee410 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1505 microversion: 2.1 time: 0.170659 May 26 18:01:39.759765 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 130/281] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:39 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:39.785310 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75aae2c2-6bd5-460e-bb10-c4c18e2d0334"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:39.786457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:39.793269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.793902 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.795059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.795343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.821871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] HTTP exception thrown: Cannot 'attach_volume' instance 25b24c05-9d81-4199-8295-d51b05cb919f while it is in vm_state rescued May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Request method failure captured: May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/os-volume_attachments HTTP/1.1 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 74 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8ATla5nyp_QRlNI0k-JA_Y0IggjggSnxXeVUTbGrptaHWmjHRxzuU404trg_8oO3HOT7VyFf3EyUgqOHBj4zYl4YnXjLmmSoYoOaoXfSRZ4aY8YSlVWR3QHlmpbQep_pf8DkEh9C7HBH0UzmhL-e0Tm-PY_nq_vSskaGps5Wz4c0BY May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:01:39.823502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3b0036437f8d4f2aaa19e707199916e3", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: dbee2da50ee6413db771071900703e29 May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {"volumeAttachment": {"volumeId": "75aae2c2-6bd5-460e-bb10-c4c18e2d0334"}} May 26 18:01:39.825135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Cannot 'attach_volume' instance 25b24c05-9d81-4199-8295-d51b05cb919f while it is in vm_state rescued May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'server_id': '25b24c05-9d81-4199-8295-d51b05cb919f', 'body': {'volumeAttachment': {'volumeId': '75aae2c2-6bd5-460e-bb10-c4c18e2d0334'}}} May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 25b24c05-9d81-4199-8295-d51b05cb919f in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:01:39.825826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 25b24c05-9d81-4199-8295-d51b05cb919f while it is in vm_state rescued May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:01:39.827034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 25b24c05-9d81-4199-8295-d51b05cb919f while it is in vm_state rescued May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Returning 409 to user: Cannot 'attach_volume' instance 25b24c05-9d81-4199-8295-d51b05cb919f while it is in vm_state rescued {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d7735387-6dd0-46fc-8b1b-5944eca8131c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044201 May 26 18:01:39.828037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 152/282] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:01:39 2022] POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:01:39.834269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:39.834796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:39.841348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.841795 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:39.843560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:39.844179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.032872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:40.033697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:40.041180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.041625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.042384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.043569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.082541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7c976995-4ed6-4c77-a620-75aa9e1295af tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/action" status: 202 len: 0 microversion: 2.1 time: 0.251730 May 26 18:01:40.083645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 131/283] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:01:39 2022] POST /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:01:40.100271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:40.111345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:40.111345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.111345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.111345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:40.111870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:40.128151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.136083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7efe2127-98b5-4314-a1fa-293d5fbe4f68 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1269 microversion: 2.1 time: 0.108005 May 26 18:01:40.136685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 153/284] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:40 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1269 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:40.253787 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:40.262123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cbaafa76-8daf-4cf0-a2a5-7569158ebad0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1513 microversion: 2.1 time: 0.173540 May 26 18:01:40.262864 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 132/285] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:40 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:41.182234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:41.182888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:41.189225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.189932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.190769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.191319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.260385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:41.269186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dda37600-fc44-46fa-b75e-d7befcc79d53 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1287 microversion: 2.1 time: 0.091459 May 26 18:01:41.269761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 154/286] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:41 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:41.287147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:41.287870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:41.296259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.296842 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.297715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.298151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.393303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-539919235", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "networks": [{"uuid": "601caa42-a769-40c8-9cae-3204fe1f04cb"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:41.443270 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] validate_networks() for [('601caa42-a769-40c8-9cae-3204fe1f04cb', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:41.489870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:41.498301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-eba86290-dd18-4913-abbf-6f61eb1c8a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1513 microversion: 2.1 time: 0.223007 May 26 18:01:41.499160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 133/287] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:41 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:41.847745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:41.848164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:41.848632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:41.849035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:41.849442 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:41.859336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.860933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.860933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:41.861191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:41.878775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Getting quotas for project ed709461c5a0499abc1a9cc33a8f916d. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:41.883713 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Getting quotas for user 99f2374b551741f4bc602debd1df336b and project ed709461c5a0499abc1a9cc33a8f916d. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:41.896532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:41.898793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:42.031805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-12cee6ab-09ea-4b40-9c65-436044d85176 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.651261 May 26 18:01:42.032711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 155/288] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:01:41 2022] POST /compute/v2.1/servers => generated 382 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:01:42.043824 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-94bafe8c-3f12-4f86-8146-041178468624 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:42.044754 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-94bafe8c-3f12-4f86-8146-041178468624 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:42.103747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-94bafe8c-3f12-4f86-8146-041178468624 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:42.112982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-94bafe8c-3f12-4f86-8146-041178468624 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1222 microversion: 2.1 time: 0.073805 May 26 18:01:42.113425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 134/289] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:42 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:42.294009 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:42.294750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:42.301929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.303776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.307079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.307079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.454936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:42.468189 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1a0f8f5d-4ab2-4c17-a069-037db6fbb966 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.178774 May 26 18:01:42.468779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 156/290] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:42 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:42.516520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:42.517124 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:42.524101 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.524551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.525310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:42.525740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:42.677691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:42.688109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7e480237-3ecf-4dd8-bc6b-4b99ac3b333e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1513 microversion: 2.1 time: 0.175134 May 26 18:01:42.688729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 135/291] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:42 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:43.130927 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c4d3335a-58bf-450f-9663-ebca2692f2bf tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.131561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c4d3335a-58bf-450f-9663-ebca2692f2bf tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.187070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c4d3335a-58bf-450f-9663-ebca2692f2bf tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.193749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c4d3335a-58bf-450f-9663-ebca2692f2bf tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1222 microversion: 2.1 time: 0.066802 May 26 18:01:43.194309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 157/292] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:43.495213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.495213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.495213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:43.495827 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.496917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.497980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.498449 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.640685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.648787 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-40a0c014-61d4-4304-8e5e-22bd72f48c2c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.166915 May 26 18:01:43.650681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 136/293] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:43.705379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:43.705987 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:43.712096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.712548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.713342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:43.713776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:43.875214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:43.884092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eff301db-61fa-4fc6-b24b-4b42d69c103c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1513 microversion: 2.1 time: 0.182447 May 26 18:01:43.884666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 158/294] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:43 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1513 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:44.210733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:44.211521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:44.218349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.219134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.220160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.220659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.285151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.294884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e7219bea-8967-4ac2-9c75-a6d3d549c805 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1218 microversion: 2.1 time: 0.087227 May 26 18:01:44.295688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 137/295] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:44 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:44.672213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:44.672855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:44.689614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.690248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.691137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.691574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.739772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-94971971-7d5b-4f88-bb73-09372f5f6ab4 req-7a5cee79-4a69-4668-ac91-31f694e6fb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da1fee2-eaed-4950-962d-3ed6708a8f0d", "tag": "02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:44.771363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-94971971-7d5b-4f88-bb73-09372f5f6ab4 req-7a5cee79-4a69-4668-ac91-31f694e6fb3c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.772019 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-94971971-7d5b-4f88-bb73-09372f5f6ab4 req-7a5cee79-4a69-4668-ac91-31f694e6fb3c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.818857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-94971971-7d5b-4f88-bb73-09372f5f6ab4 req-7a5cee79-4a69-4668-ac91-31f694e6fb3c service nova] Creating event network-changed:02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c for instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d on hv-cinder-83607 May 26 18:01:44.827920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-94971971-7d5b-4f88-bb73-09372f5f6ab4 req-7a5cee79-4a69-4668-ac91-31f694e6fb3c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094959 May 26 18:01:44.836728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 138/296] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:44.903767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:44.904493 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:44.915789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.916360 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.917303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:44.918394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:44.962754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:44.977349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c0dee88b-3710-4e58-813b-df2d835ba3c8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.304789 May 26 18:01:44.982018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 159/297] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:44 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:45.093502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:45.102095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0a76e7da-cf02-456b-8203-8d058d9249e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1519 microversion: 2.1 time: 0.204060 May 26 18:01:45.103085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 139/298] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:44 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:45.312840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:45.313618 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:45.322641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.325753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.325753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:45.325753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:45.408912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:45.417021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-20c0d1e4-ba5c-4f29-bd8e-e1d06d482db1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1274 microversion: 2.1 time: 0.108720 May 26 18:01:45.418643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 160/299] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:45 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1274 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:45.994088 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:45.998056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:46.009584 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.017509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.017509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.017509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.200003 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.211350 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d29ee596-76b7-4730-8e67-2ee0a8eea620 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.225556 May 26 18:01:46.212552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 140/300] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:45 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:46.435995 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:46.436887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:46.443943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.444491 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.445380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:46.445890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:46.466487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:46.519470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:46.534236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7a07d135-7ebc-4163-a6b5-0b3dc3d8856a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1280 microversion: 2.1 time: 0.103114 May 26 18:01:46.535137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 161/301] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:46 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:47.229373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:47.229920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:47.237234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.237695 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.238465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.239011 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.381784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:47.389484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0a41a43f-8f49-485d-bcfa-0c1b3d070a08 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.164062 May 26 18:01:47.393747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 141/302] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:47 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:47.552748 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:47.553362 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:47.560887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.561337 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.562105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:47.562540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:47.703881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:47.711731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cbe70a6f-530c-4499-a850-d4c1c9f2c2e3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.162858 May 26 18:01:47.712513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 162/303] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:47 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:47.929224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ebdf4ea1-cd09-4aef-8407-d5c76006d348 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: .version_select at 0x7f4b8a225550>, body: {"keypair": {"name": "tempest-keypair-209141465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmI23YtY3xImLMfQHRQaqQBPo4eyGSfB3LdXlvcSGj74pnF8DtRtBWT78dw4T+zEZ9tsurLmALKC0q4ev7OSDmBC7PxSyp68CTGMyHmrm6OFoiEki/OGiruY8l5/W6H/A=="}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:47.933301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:47.953862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-ebdf4ea1-cd09-4aef-8407-d5c76006d348 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:47.953862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-ebdf4ea1-cd09-4aef-8407-d5c76006d348 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for user dbee2da50ee6413db771071900703e29 and project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:48.085076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ebdf4ea1-cd09-4aef-8407-d5c76006d348 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159280 May 26 18:01:48.085958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 142/304] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:01:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:01:48.406040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:48.406699 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:48.413074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.413597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.414446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.414901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.568730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:48.580253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c46b1ccd-bab6-4eb3-83f6-ebb4ccef38e1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.178583 May 26 18:01:48.581431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 163/305] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:48 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:48.730858 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:48.731567 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:48.738162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.738632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.739447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:48.739893 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:48.900371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:48.909346 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-805925f5-084e-48ea-b728-06fec2d2e24a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.183348 May 26 18:01:48.910064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 143/306] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:48 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:49.606249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:49.608039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:49.615476 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.615929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.617089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.617669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.936518 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:49.937689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:49.946885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.947331 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.949860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:49.950587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:49.957954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:49.976337 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e8fd6c12-53cb-4c70-996f-5b6a63746bac tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.381573 May 26 18:01:49.977842 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 164/307] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:49 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:50.387720 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:50.396841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-504523f7-31c6-4ee8-9ae2-b0c8dc96be70 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.469090 May 26 18:01:50.397437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 144/308] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:49 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:50.527957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-17955dec-52e3-44c8-812c-6a774ec26cd3 req-5a87c755-f1d2-467f-ac4a-1d151265c8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08086f84-b944-467c-b7ae-3ed16c986ca8", "tag": "30cb6d11-16b7-42f0-bee7-4184d788ec10"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:50.537022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-17955dec-52e3-44c8-812c-6a774ec26cd3 req-5a87c755-f1d2-467f-ac4a-1d151265c8d3 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:50.537559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-17955dec-52e3-44c8-812c-6a774ec26cd3 req-5a87c755-f1d2-467f-ac4a-1d151265c8d3 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:50.550478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-17955dec-52e3-44c8-812c-6a774ec26cd3 req-5a87c755-f1d2-467f-ac4a-1d151265c8d3 service nova] Creating event network-changed:30cb6d11-16b7-42f0-bee7-4184d788ec10 for instance 08086f84-b944-467c-b7ae-3ed16c986ca8 on hv-cinder-83607 May 26 18:01:50.555769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-17955dec-52e3-44c8-812c-6a774ec26cd3 req-5a87c755-f1d2-467f-ac4a-1d151265c8d3 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 May 26 18:01:50.564842 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 165/309] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:50.875704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247575481", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c20ae16-163c-4137-8a9f-95e057614528"}], "security_groups": [{"name": "tempest-securitygroup--512160046"}], "key_name": "tempest-keypair-209141465", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:50.987754 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] validate_networks() for [('8c20ae16-163c-4137-8a9f-95e057614528', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:01:50.995146 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:50.995857 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:51.004000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.004688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.007586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.007586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.203463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.213630 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-48498cdf-4e2d-4615-a1dc-62775a19bc6c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.223330 May 26 18:01:51.225300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 166/310] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:50 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:51.413669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:51.414280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:51.421449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.421897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.422666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.423131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.452927 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:01:51.453345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:01:51.453815 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:01:51.454225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:01:51.454633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:01:51.465333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.465838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.466737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.467304 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:51.485359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:01:51.489670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Getting quotas for user dbee2da50ee6413db771071900703e29 and project 3b0036437f8d4f2aaa19e707199916e3. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:01:51.501206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:01:51.503567 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:01:51.564702 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.572109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e7b6e235-2035-49fe-8e13-31a1212c9555 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.162294 May 26 18:01:51.572678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 167/311] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:51 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:51.632766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-94d744fb-ea61-4238-93d6-9bff87a42a5e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 410 microversion: 2.1 time: 0.761794 May 26 18:01:51.633487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 145/312] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:01:50 2022] POST /compute/v2.1/servers => generated 410 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:01:51.644173 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c0927f8e-99a7-48b7-9c03-28df46c73494 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:51.644871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c0927f8e-99a7-48b7-9c03-28df46c73494 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:51.700616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0927f8e-99a7-48b7-9c03-28df46c73494 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:51.707426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c0927f8e-99a7-48b7-9c03-28df46c73494 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1249 microversion: 2.1 time: 0.067318 May 26 18:01:51.707990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 168/313] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:51 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:51.979645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5e0a74a5-8191-4082-afa9-5619f960bcb6 req-7a09dc39-c809-42f6-a8a0-1fdd9e4876df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da1fee2-eaed-4950-962d-3ed6708a8f0d", "name": "network-vif-plugged", "status": "completed", "tag": "02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:01:51.994542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5e0a74a5-8191-4082-afa9-5619f960bcb6 req-7a09dc39-c809-42f6-a8a0-1fdd9e4876df service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:51.995274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5e0a74a5-8191-4082-afa9-5619f960bcb6 req-7a09dc39-c809-42f6-a8a0-1fdd9e4876df service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.006009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5e0a74a5-8191-4082-afa9-5619f960bcb6 req-7a09dc39-c809-42f6-a8a0-1fdd9e4876df service nova] Creating event network-vif-plugged:02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c for instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d on hv-cinder-83607 May 26 18:01:52.011210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5e0a74a5-8191-4082-afa9-5619f960bcb6 req-7a09dc39-c809-42f6-a8a0-1fdd9e4876df service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 May 26 18:01:52.012660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 146/314] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:01:52.231898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.232499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.234443 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:52.239455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.239901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.240654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.241149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.380906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.390844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-80425145-6ccd-4f9c-8dad-078e6fa35c7e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.163023 May 26 18:01:52.391554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 169/315] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:52.589767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.591150 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.597430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.597880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.598673 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.599143 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.724926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:52.725689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:52.732402 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.732804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.733586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:52.734025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:52.735326 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.743095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-84312763-2b7d-4cb3-82ec-a74344b89afc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.157773 May 26 18:01:52.743659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 147/316] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:52.795095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:52.802638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-040fd937-ca02-45f0-8324-5846e6a78844 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.081587 May 26 18:01:52.803230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 170/317] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:52 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:53.407791 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:53.409130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:53.415805 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.416287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.417050 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.417481 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.556797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:53.559909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:53.565737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1c70f0e6-9549-494e-a9c6-d3a8d1542fde tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.161789 May 26 18:01:53.566300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 148/318] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:53 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:53.760043 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:53.760679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:53.767533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.767985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.768754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.769191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.821648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:53.822274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:53.829707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.830166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.831032 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:53.831475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:53.906522 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:53.914388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b70a5314-7f38-4147-9c50-ee7880d02ca0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.096766 May 26 18:01:53.914988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 149/319] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:53 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:53.929730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:53.937560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0ca81b69-89bc-42b5-8936-470e1831ef38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.181333 May 26 18:01:53.938126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 171/320] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:53 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:54.582990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:54.583604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:54.590222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.590700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.591494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.591930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.726582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:54.734574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-30424052-b754-4de7-9aa8-a75b4d4f8e94 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.155527 May 26 18:01:54.735177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 150/321] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:54 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:54.932280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:54.932822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:54.939919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.940371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.941149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.941591 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.954141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:54.954761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:54.960820 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.961265 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:54.962073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:54.962591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.011402 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.019225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-850f4023-c803-4c7b-b6da-2ecfc012e3e7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.090786 May 26 18:01:55.019781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 172/322] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:54 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:55.099829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.108088 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d964bc69-e21e-430e-9425-ca7c83c682c2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.157908 May 26 18:01:55.108695 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 151/323] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:54 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:55.752120 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:55.752639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:55.759455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.759915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.760741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:55.761179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:55.893733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:55.901188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5814028e-25fe-4a2b-8161-f84dab87818d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.152970 May 26 18:01:55.901763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 173/324] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:55 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.035464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.035996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.042692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.043823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.044679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.045120 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.106832 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.115822 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2ccc5d57-7355-4e6b-9a21-fd329bfef159 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.084479 May 26 18:01:56.116407 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 152/325] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.124870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.125504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.131509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.131967 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.132751 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.133193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.267188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:56.274618 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c4640bc5-f91c-496b-ad02-7e911470ba0a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.154549 May 26 18:01:56.275211 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 174/326] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:56.922655 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:56.923869 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:56.931205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.931654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:56.932408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:56.932839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.066638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.074168 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-35a802f0-0bb2-48fd-bac1-69468f7c08b3 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.158599 May 26 18:01:57.074724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 153/327] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:56 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:57.132986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:57.133631 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:57.140392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.140850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.141627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.142071 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.210607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.218439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c9c8b136-5832-4cf7-be1f-4f27a4dc2be0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.089310 May 26 18:01:57.219032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 175/328] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:57 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:57.292552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:57.293165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:57.299889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.300339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.301109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:57.301546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:57.432452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:57.441229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dd2e5ef1-4ee3-4322-be0a-b3eaf9e87ef2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.152564 May 26 18:01:57.441799 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 154/329] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:57 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:58.091804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:58.092420 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:58.098679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.099165 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.099943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.100380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.234984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:58.235789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:58.236406 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:58.242987 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7faaa494-4bc4-47cc-b595-a4b2f1072ee4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.155385 May 26 18:01:58.243170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.243461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.243664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 176/330] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:58 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:58.244237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.244675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.306552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:58.313930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4960a4e1-bf43-43b5-a2a4-d27f3a5aa590 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.082795 May 26 18:01:58.314486 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 155/331] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:58 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:58.457717 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:58.458338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:58.464455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.464910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.465666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:58.466131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:58.597017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:58.604642 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-86e90419-813c-49b8-a36d-d81615f6d35f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.150820 May 26 18:01:58.605200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 177/332] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:58 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:59.261426 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.262100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.269512 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.269963 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.270741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.271299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.331323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.332607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.348729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.349178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.349964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.350400 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.429191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.432758 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.437926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3466af4b-29ee-4bd6-b64b-e2a6fb606445 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.109601 May 26 18:01:59.438536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 178/333] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:01:59.441569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2536816e-2dea-4443-a7d2-ebb8cf8f0ec1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.184756 May 26 18:01:59.442161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 156/334] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:01:59.621720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:01:59.623072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:01:59.630048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.630619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.631814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:01:59.632437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:01:59.650499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:01:59.774058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:01:59.782053 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b37dca56-a0c3-4b4c-96cd-01ce49c23fde tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.164503 May 26 18:01:59.782694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 179/335] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:01:59 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:00.454901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.455499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.458574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.459217 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.461639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.462091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.462933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.463321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.465725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.466024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.467526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.467973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.532318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.540071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b2cadf50-9db2-4032-bb57-b0dd337d6a42 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1253 microversion: 2.1 time: 0.089926 May 26 18:02:00.540923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 157/336] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1253 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:00.618476 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.627000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-54ed39d3-a021-466d-8d97-ed220cadea57 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.172099 May 26 18:02:00.627574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 180/337] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:00.799607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:00.800127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:00.806604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.807218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.808001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:00.808437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:00.951806 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:00.961673 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1c3da0f0-9153-4a74-a48f-44ca46bc9d44 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.166052 May 26 18:02:00.962269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 158/338] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:00 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:01.558833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.559482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.567283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.567741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.568520 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.568996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.630533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.638261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2561a74a-e166-4afd-a190-9e1528ec151c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1245 microversion: 2.1 time: 0.083286 May 26 18:02:01.643545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 181/339] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:01.644350 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.644803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.647067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.647736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=18 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.652637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.653091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.654209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.654519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.791718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:01.800088 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3edac17d-9c61-4f7d-aaa1-e4e22f0428b4 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.159659 May 26 18:02:01.800657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 159/340] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:01.980229 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:01.980861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:01.983349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=14 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:01.988291 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.988674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:01.989448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:01.989881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.126097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:02.133563 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3f2b67fc-c973-4c12-b0ff-12827d0bdaf6 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.157249 May 26 18:02:02.134147 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 182/341] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:01 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:02.656153 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:02.656966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:02.664107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.664560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.665336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.666006 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.729553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:02.738310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-50672ac4-0624-447e-92dc-f52a72bb4224 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1245 microversion: 2.1 time: 0.086466 May 26 18:02:02.738906 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 160/342] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:02 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:02.817807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:02.818416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:02.820401 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:02.825385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.825831 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.827440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:02.827887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:02.965502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:02.973394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-02554ff5-956a-4114-abdc-b70dd2395ba1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.159373 May 26 18:02:02.974561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 183/343] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:02 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:03.151694 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:03.152306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:03.161146 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.161531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.162296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.162768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.298004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:03.305750 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f8b9dd92-abdc-4276-8c7c-3e4a535e8595 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.158058 May 26 18:02:03.306333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 161/344] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:03 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:03.755909 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:03.756436 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:03.762440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.762923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.764193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.764975 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.825233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:03.833503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d822a5da-3b99-4cf3-a015-5f3bce32e686 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1245 microversion: 2.1 time: 0.081461 May 26 18:02:03.834062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 184/345] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:03 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:03.990002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:03.990619 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:03.997451 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.997913 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:03.998842 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:03.999284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.133849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:04.141770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e4353647-e355-4dfb-8371-262b5a9090a9 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.155523 May 26 18:02:04.142367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 162/346] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:03 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:04.322985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:04.323602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:04.329937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.330315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.331109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.331548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.470084 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:04.478708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-221eac66-b299-43c5-aa4b-d78c7aaa4c73 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.159575 May 26 18:02:04.479434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 185/347] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:04 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:04.851020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:04.851628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:04.857788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.859298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.859883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:04.860403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:04.928638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:04.936117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8fdcf69e-67c4-4a05-8970-9d54ec2df1a8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1245 microversion: 2.1 time: 0.089103 May 26 18:02:04.936937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 163/348] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:04 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:05.159679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:05.160279 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:05.166653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.167312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.168101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.168524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.304576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:05.312497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6a0666ba-afcb-4193-8db3-ad53aa41af96 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.157563 May 26 18:02:05.313077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 186/349] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:05 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:05.496229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:05.496902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:05.504095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.504542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.505297 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.505730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.650063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:05.657882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b2e8f77b-cb06-4e2a-9003-090ee94d1372 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.165449 May 26 18:02:05.658446 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 164/350] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:05 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:05.954617 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:05.955364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:05.961957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.962543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:05.963250 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:05.963706 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.028673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:06.036610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a0e32ecc-320e-4b8d-9f6c-10d6537847c0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1301 microversion: 2.1 time: 0.086527 May 26 18:02:06.037186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 187/351] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:05 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:06.329651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:06.330555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:06.336434 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.336892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.337666 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.338188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.353782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:06.475304 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:06.482800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-76d3ed88-0e4a-40a6-a4ec-02a37ac87c4b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.157271 May 26 18:02:06.484131 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 165/352] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:06 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:06.675326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:06.675988 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:06.682346 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.682800 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.683607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:06.684072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:06.829294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:06.837174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-68381a07-dd01-407e-ab57-41ffff8b32e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.165922 May 26 18:02:06.837653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 188/353] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:06 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:07.029550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-e6b9dc9b-1536-42ca-8444-46ece5222990 req-f56c9a9e-fcba-48b2-9877-ad008ee6566f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08086f84-b944-467c-b7ae-3ed16c986ca8", "name": "network-vif-plugged", "status": "completed", "tag": "30cb6d11-16b7-42f0-bee7-4184d788ec10"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:07.038632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-e6b9dc9b-1536-42ca-8444-46ece5222990 req-f56c9a9e-fcba-48b2-9877-ad008ee6566f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.039099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-e6b9dc9b-1536-42ca-8444-46ece5222990 req-f56c9a9e-fcba-48b2-9877-ad008ee6566f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.050286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-e6b9dc9b-1536-42ca-8444-46ece5222990 req-f56c9a9e-fcba-48b2-9877-ad008ee6566f service nova] Creating event network-vif-plugged:30cb6d11-16b7-42f0-bee7-4184d788ec10 for instance 08086f84-b944-467c-b7ae-3ed16c986ca8 on hv-cinder-83607 May 26 18:02:07.053419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:07.056018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:07.056245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-e6b9dc9b-1536-42ca-8444-46ece5222990 req-f56c9a9e-fcba-48b2-9877-ad008ee6566f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029414 May 26 18:02:07.056245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 166/354] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:07.060274 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.060735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.062349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.062978 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.125697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:07.136698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b93bfd33-7d23-4d50-b08e-20d919806a57 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1301 microversion: 2.1 time: 0.087069 May 26 18:02:07.151825 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 189/355] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:07 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:07.502276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:07.503004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:07.509108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.515382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.515382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.515382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.651914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:07.662539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c2c29e7d-822d-46c0-a84a-2cb2fe1cddbe tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.164317 May 26 18:02:07.663500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 167/356] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:07 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:07.854905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:07.856233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:07.864728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.865184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:07.866933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:07.871897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.006062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:08.014649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c03488d4-3741-462d-8a78-edeae0794e05 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.163831 May 26 18:02:08.015380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 190/357] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:07 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:08.162369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:08.163046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:08.169641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.170094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.171048 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.171490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.239061 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:08.247031 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a556f991-4bbf-4b85-9817-03fc098ac65f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1319 microversion: 2.1 time: 0.088456 May 26 18:02:08.247603 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 168/358] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:08 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1319 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:08.686143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:08.687449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:08.693746 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.694198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.695020 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:08.695455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:08.832033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:08.840152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5372c6ae-040b-4958-a5ed-22bc7d971a1b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1317 microversion: 2.1 time: 0.158230 May 26 18:02:08.840718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 191/359] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:08 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:09.032226 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:09.032756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:09.039386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.039837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.044141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.044141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.185338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:09.193927 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-580f94a6-476e-4b52-8fea-98fb352b8755 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.166025 May 26 18:02:09.194501 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 169/360] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:09 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:09.271499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:09.272633 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:09.278734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.279413 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.280951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.281679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.368770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:09.377377 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9e6e3e53-8d8a-4921-9b2d-196ae93b5964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1307 microversion: 2.1 time: 0.109828 May 26 18:02:09.378432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 192/361] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:09 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:09.863717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:09.864481 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:09.871598 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.872040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:09.872852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:09.873301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.013356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:10.021154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e6e461a2-6c2a-4cb7-b486-d2896e1444ef tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1500 microversion: 2.1 time: 0.167892 May 26 18:02:10.021786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 170/362] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:09 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1500 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:10.211038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:10.211651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:10.218278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.218736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.219541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.220025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.355944 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:10.359121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-48be2a6d-45bf-4913-86c8-eae423e3bc65 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.151238 May 26 18:02:10.359832 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 193/363] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:10 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:10.398830 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:10.399452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:10.406564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.407200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.408000 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:10.408535 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:10.540174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:10.547622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-680f476b-8d1c-4996-8b52-fe1eb1a080da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.152608 May 26 18:02:10.548194 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 171/364] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:10 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:11.376218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:11.376824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:11.383039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.384866 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.384866 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.384866 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.515313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:11.523029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d23f531-045f-4beb-9c04-027491b8f1fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.150668 May 26 18:02:11.523636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 194/365] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:11 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:11.564986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:11.565609 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:11.572157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.572606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.573361 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:11.573793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:11.709923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:11.718293 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-85b43284-5bf6-4081-8516-3cf3aaba510e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.157516 May 26 18:02:11.718999 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 172/366] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:11 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:12.540503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:12.541090 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:12.547939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.548382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.549143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.549578 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.679957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:12.687725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5ba4cee2-b140-4bbd-a4e3-6b4daaa278d8 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.151060 May 26 18:02:12.688294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 195/367] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:12 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:12.740183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:12.740797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:12.747793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.748249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.749248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:12.749645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:12.882355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:12.890575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ceb093db-a7f0-41e0-8609-d445c1ecff50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.154184 May 26 18:02:12.891170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 173/368] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:12 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:13.707397 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:13.708006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:13.714216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.714667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.715460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.715897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.719181 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:13.856674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:13.865775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f7a7d8cf-a040-4ba3-b134-1e5ff8daf925 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.164475 May 26 18:02:13.866467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 196/369] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:13 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:13.907013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:13.907625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:13.914493 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.914982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:13.915903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:13.916383 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:14.048321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:14.055733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4df9a002-247c-4fb3-9f9e-313abae7318f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.152862 May 26 18:02:14.056301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 174/370] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:13 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:14.885900 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:14.887152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:14.895875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.896232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:14.897245 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:14.897704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.040366 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:15.048573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d6d03d1-4b6d-43d1-9f48-4f6f2fdceb77 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1322 microversion: 2.1 time: 0.168587 May 26 18:02:15.049156 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 197/371] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:14 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:15.072399 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:15.073105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:15.079860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.080404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.081234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.081738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.212184 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:15.219995 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6940f0d7-4309-4c9e-b7e7-d4db6978977a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.151400 May 26 18:02:15.220566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 175/372] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:15 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:15.638009 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-460dbf9c-32ed-4bf9-a780-ffac73504d51 req-8ddeac2c-bc1e-4551-8e9b-5b4c2bc385d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:15.647398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-460dbf9c-32ed-4bf9-a780-ffac73504d51 req-8ddeac2c-bc1e-4551-8e9b-5b4c2bc385d7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:15.647835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-460dbf9c-32ed-4bf9-a780-ffac73504d51 req-8ddeac2c-bc1e-4551-8e9b-5b4c2bc385d7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:15.661424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-460dbf9c-32ed-4bf9-a780-ffac73504d51 req-8ddeac2c-bc1e-4551-8e9b-5b4c2bc385d7 service nova] Creating event network-changed:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:02:15.666811 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-460dbf9c-32ed-4bf9-a780-ffac73504d51 req-8ddeac2c-bc1e-4551-8e9b-5b4c2bc385d7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034145 May 26 18:02:15.668156 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 198/373] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:16.067605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:16.068492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:16.074943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.075607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.077007 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.078115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.127660 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:16.131378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:16.139372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.141488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.142092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.142698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.177247 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:02:16.259110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:16.279936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a2090a6a-f618-4e3a-a1aa-4bd88c88818b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1510 microversion: 2.1 time: 0.205373 May 26 18:02:16.283400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 176/374] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:16 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:16.289786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:16.290610 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:16.298273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.299013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.300117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.300708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.498689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:16.503245 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c5d014d5-2861-424f-949b-6dd61b964a58 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 204 len: 0 microversion: 2.1 time: 0.380949 May 26 18:02:16.507940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 199/375] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:02:16 2022] DELETE /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:02:16.513459 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9f56924c-efbb-4ba2-bd03-a4e20fbc446e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.227753 May 26 18:02:16.514266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:16.515773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:16.518002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 177/376] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:16 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:16.522201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.522895 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.523836 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:16.524275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:16.679126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:16.687390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b9281974-e230-4de3-ac17-7f4e937a124d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.178248 May 26 18:02:16.687962 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 200/377] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:16 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:17.534057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:17.534984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:17.541670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.542117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.542906 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.543341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.682882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:17.691362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6b8a5291-c777-4d83-a226-e50fa866c0e5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.161393 May 26 18:02:17.692870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 178/378] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:17 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:17.706147 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:17.706682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:17.713135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.714728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.714728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:17.714947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:17.857495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:17.866392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-01cf5ce1-d2a1-4db8-95f0-23b863536eeb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.165328 May 26 18:02:17.867232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 201/379] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:17 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:18.709786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:18.710496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:18.712997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:18.718271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.718961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.719752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.720187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.859062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:18.866662 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-30b87517-f2ee-423e-a21b-e533261ceeee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.160971 May 26 18:02:18.867334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 179/380] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:18 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:18.883976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:18.884585 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:18.891480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.891928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:18.892710 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:18.893153 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:19.023370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:19.031937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2471f32d-c913-4534-8c99-c9c731d6cd77 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.151698 May 26 18:02:19.032549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 202/381] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:18 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:19.884085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:19.884702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:19.892459 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:19.892892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:19.893665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:19.894108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.034952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:20.042482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9e11469f-b15e-49d6-b692-6acb8906c8b7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.162317 May 26 18:02:20.043320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 180/382] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:19 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:20.048932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:20.049540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:20.055740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:20.056188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.056948 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:20.057380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:20.191855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:20.199228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dd4bae4c-e321-4a9d-9414-c726dc2b5deb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.154733 May 26 18:02:20.199792 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 203/383] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:20 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:21.059383 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:21.060000 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:21.067916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.068414 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.069209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.069649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.199823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:21.207362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a0c5a3aa-82b0-4bf5-a84b-eb5d27aece53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.151865 May 26 18:02:21.207934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 181/384] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:21 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:21.217036 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:21.217643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:21.224182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.224762 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.225388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:21.225815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:21.361201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:21.368816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d74e77ca-2d61-4dbd-94e3-5d669890613c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.155705 May 26 18:02:21.369417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 204/385] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:21 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:22.224483 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:22.225023 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:22.231545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.231998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:22.232872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.233314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:22.367798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:22.369946 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:22.376857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-51d52198-4405-4977-b725-4b910aa76005 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.156232 May 26 18:02:22.377797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 182/386] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:22 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:22.385248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:22.385858 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:22.391967 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.392416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:22.393172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:22.393601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:22.523718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:22.531133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8d2c65ca-8b09-4c6b-b4e4-02808070ecd8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.149608 May 26 18:02:22.531960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 205/387] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:22 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:23.394462 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:23.395125 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:23.402744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:23.403246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:23.404063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:23.404503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:23.551346 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:23.553209 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:23.553991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:23.559447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7ba00af1-debb-41da-9c85-241abab2acf6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.169460 May 26 18:02:23.560066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 183/388] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:23 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:23.564201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:23.564919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:23.565726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:23.566171 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:23.713873 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:23.722712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-43fe0f7f-cd6b-4988-b305-7cbba0daeca0 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.176854 May 26 18:02:23.723339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 206/389] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:23 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:24.576733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:24.577404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:24.584737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.585188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.585966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.586405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.741072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:24.746495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:24.749993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.750515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.752431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:24.752656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:24.960454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:24.968227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3f1766e9-f040-4bbb-b519-3d13fa2f250b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.395333 May 26 18:02:24.968813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 184/390] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:24 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:25.007920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:25.015478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3360415f-ac53-4197-b6d8-ecb02c2afc95 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.278663 May 26 18:02:25.016073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 207/391] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:24 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:25.985761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:25.987019 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:25.994264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.994669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:25.995428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:25.995950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.034011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:26.034637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:26.041280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.047059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.047059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:26.047059 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:26.192186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:26.199918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3a3e20be-3cfb-4cfa-8284-cf3a4e99d917 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.217983 May 26 18:02:26.200735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 185/392] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:25 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:26.215513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:26.223991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-540cf0cf-57ca-4b69-9687-97fd19632f64 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.194695 May 26 18:02:26.224561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 208/393] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:26 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:27.217284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:27.218034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:27.225271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.226093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.226858 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.227386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.241922 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:27.242661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:27.249314 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.249761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.250682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:27.251142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:27.439514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:27.446266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:27.449217 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2a87f628-c726-4407-b724-d982462649d5 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.235644 May 26 18:02:27.449886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 186/394] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:27 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:27.458552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1c1d4be1-3d5d-415e-934f-034926842b0b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.220601 May 26 18:02:27.459164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 209/395] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:27 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:28.466875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:28.467450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:28.474745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.475232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.476002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.476448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.480230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:28.481022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:28.487066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.487538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.488328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:28.488761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:28.663546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:28.671442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-112f343d-4f93-4961-a8bb-6a9b34b17859 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.208444 May 26 18:02:28.672023 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 187/396] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:28 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:28.684722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:28.693172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ec1d6201-0455-4c73-8556-5a29f2ce5e36 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.216737 May 26 18:02:28.693743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 210/397] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:28 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:29.689057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:29.689694 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:29.695935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.696389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.697147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.697580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.709377 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:29.710045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:29.716299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.716754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.723225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:29.723225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:29.907884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:29.912257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:29.914643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:29.916661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5a11f279-9578-4a2e-9b06-193c370fbc0b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.231411 May 26 18:02:29.917278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 188/398] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:29 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:29.922687 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1f72f76a-8ccf-4791-8582-287595d3cdb7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.215381 May 26 18:02:29.922687 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 211/399] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:29 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:30.934874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:30.935490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:30.938324 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:30.938978 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:30.942264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.942623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.943428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.943863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.945879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.946336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:30.947150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:30.948879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:31.151909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:31.160137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:31.161018 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5ae1e372-4511-4472-8ff6-51fedadd0b18 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.229912 May 26 18:02:31.161672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 189/400] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:30 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:31.168317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8fb28d0c-05df-46bd-ad21-47f3401eaa5e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.233726 May 26 18:02:31.168880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 212/401] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:30 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:32.181115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:32.181115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:32.185308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:32.185949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:32.186454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.186938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.187753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.188192 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.192873 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.193317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.194185 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:32.194616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:32.382541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:32.391352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e09cd8f1-1ce7-4459-97a1-713d3da55b6e tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.217484 May 26 18:02:32.397159 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 190/402] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:32 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:32.399554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:32.408225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b1317297-720c-42c8-b58c-7a6cad72b43e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.226762 May 26 18:02:32.409301 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 213/403] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:32 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:33.408958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:33.409769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:33.417012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.417461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.418228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.418664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.425590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:33.426448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:33.428593 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:33.433459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.434562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.435477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:33.435949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:33.635420 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:33.636695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:33.648082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f4774cad-b38e-463a-ad8d-c06c9de12561 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.242625 May 26 18:02:33.648867 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-143218fb-5f0e-43fb-affc-35bcaf79079b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.226437 May 26 18:02:33.650228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 191/404] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:33 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:33.655490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 214/405] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:33 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:34.666397 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:34.667204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:34.673677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:34.674142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.674417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:34.674575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:34.675373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.675806 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:34.681708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.682303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:34.683308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:34.684355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:34.883798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:34.888033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:34.891918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-abaa3a65-bd6f-4680-90f5-28b08de0499c tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.229403 May 26 18:02:34.892501 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 192/406] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:34 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:34.895938 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-83720f2e-311e-4daa-a3cd-03da4bc08a3c tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1506 microversion: 2.1 time: 0.227010 May 26 18:02:34.896576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 215/407] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:34 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:35.507428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5c4a1699-3cad-46ac-8423-71bc9cd5f4b8 req-9152f642-de12-4893-b06b-b817d96c63f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da1fee2-eaed-4950-962d-3ed6708a8f0d", "name": "network-vif-deleted", "tag": "02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:35.515006 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5c4a1699-3cad-46ac-8423-71bc9cd5f4b8 req-9152f642-de12-4893-b06b-b817d96c63f1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.525917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5c4a1699-3cad-46ac-8423-71bc9cd5f4b8 req-9152f642-de12-4893-b06b-b817d96c63f1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.526763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5c4a1699-3cad-46ac-8423-71bc9cd5f4b8 req-9152f642-de12-4893-b06b-b817d96c63f1 service nova] Creating event network-vif-deleted:02c53a0b-2e9a-4bb1-bf9f-53a4e02b215c for instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d on hv-cinder-83607 May 26 18:02:35.531837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5c4a1699-3cad-46ac-8423-71bc9cd5f4b8 req-9152f642-de12-4893-b06b-b817d96c63f1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029160 May 26 18:02:35.532422 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 193/408] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:35.909016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.909561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:35.914636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:35.915360 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:35.916198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.916655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.917408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.917841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.921728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.928463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:35.928463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:35.928463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:36.007100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:36.015289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4e609198-cf63-484f-8418-e32681d349c6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1464 microversion: 2.1 time: 0.105750 May 26 18:02:36.016063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 194/409] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:35 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:36.077888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:36.086149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-787b8f8d-de8c-405f-a5b2-6f38c85de49d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.181070 May 26 18:02:36.087005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 216/410] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:35 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:37.033363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:37.033968 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:37.040950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.041479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.042974 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.043098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.103916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:37.104627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:37.111423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.111822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.111991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:37.112600 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:37.113041 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:37.119956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-59abd02b-8f33-4e97-baaf-1749b5c4cc3f tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1464 microversion: 2.1 time: 0.090449 May 26 18:02:37.120536 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 195/411] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:37 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1464 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:37.246234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:37.253637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4ebb0b0f-9cbf-4543-9486-097b6cb77252 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.153910 May 26 18:02:37.254196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 217/412] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:37 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:38.137159 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:38.137835 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:38.144209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.144651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.146084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.146648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.208635 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:38.216607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6bc40a12-f792-428a-98d8-302cf2b93b41 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1464 microversion: 2.1 time: 0.083356 May 26 18:02:38.217180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 196/413] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:38 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1464 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:38.273406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:38.274185 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:38.280499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.280956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.281736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:38.282175 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:38.423261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:38.431182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-93be6c0f-8187-4a1a-99de-2a8f82347e10 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.162550 May 26 18:02:38.434879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 218/414] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:38 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:39.233627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:39.234156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:39.240793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.241240 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:39.242020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.242441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:39.306661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:39.314196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-21d05621-7315-477c-9baa-86de1a59ad92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1302 microversion: 2.1 time: 0.084475 May 26 18:02:39.314761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 197/415] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:39 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1302 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:39.449052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:39.449662 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:39.455724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.456172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:39.456933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:39.457367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:39.587976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:39.595616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0aaeab54-5afe-4994-979f-7a2ab40127d3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.151370 May 26 18:02:39.596188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 219/416] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:39 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:40.332291 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:40.340701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:40.341788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:40.342245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:40.343056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:40.343786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:40.415983 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:40.423882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1d39957d-ebf6-429c-9379-8b80966505a6 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1302 microversion: 2.1 time: 0.095660 May 26 18:02:40.424506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 198/417] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:40 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1302 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:40.613056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:40.613667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:40.620628 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:40.621083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:40.622057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:40.622513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:40.764435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:40.775194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-25e8076d-9d35-4bea-94af-3fe8562a32f1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.164946 May 26 18:02:40.776426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 220/418] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:40 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:41.440813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:41.441415 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:41.448665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.449117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.449909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.450349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.482068 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.482509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.482991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lazy-loading 'fault' on Instance uuid 1da1fee2-eaed-4950-962d-3ed6708a8f0d {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:02:41.529337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:41.532190 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:41.539548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-15e344dc-e4a3-4b57-bda1-d8d729f0ebcb tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 200 len: 1307 microversion: 2.1 time: 0.102647 May 26 18:02:41.540170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 199/419] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:41 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:41.792863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:41.793468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:41.799790 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.800238 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.801056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:41.805058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:41.943171 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:41.951776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5c4bc27d-a053-4166-9971-db8b0541e57b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.163076 May 26 18:02:41.952529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 221/420] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:41 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:42.532051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-1ca3d8a6-c6b8-42d0-aa54-17a8e675fe50 req-ed82a059-2a9f-4bba-ba56-14065c53af0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "name": "network-vif-plugged", "status": "completed", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:42.542243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-1ca3d8a6-c6b8-42d0-aa54-17a8e675fe50 req-ed82a059-2a9f-4bba-ba56-14065c53af0c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.542656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-1ca3d8a6-c6b8-42d0-aa54-17a8e675fe50 req-ed82a059-2a9f-4bba-ba56-14065c53af0c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.554657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-1ca3d8a6-c6b8-42d0-aa54-17a8e675fe50 req-ed82a059-2a9f-4bba-ba56-14065c53af0c service nova] Creating event network-vif-plugged:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:02:42.558075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:42.559481 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: 1da1fee2-eaed-4950-962d-3ed6708a8f0d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:42.560268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-1ca3d8a6-c6b8-42d0-aa54-17a8e675fe50 req-ed82a059-2a9f-4bba-ba56-14065c53af0c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034604 May 26 18:02:42.560869 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 200/421] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:42.565996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.566444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.567427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.567858 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.581651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] HTTP exception thrown: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Request method failure captured: May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d HTTP/1.1 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8B5ki7VLNBXCMJvjvgQtetFO6c6MYIqWeFbhYPujkkdFiXgw-KdkV3ZcERSulwTHEC71dv4vJPTmqDftGy0jzvFVlHi-Np4dwtbRc_92RYFRosficQTywLrYbxnziBSMRqVrAGrMI0h4K5kwyDZLUvTBJ-T3M0y0j3Z1vRgdlEF-nM May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: e358a1e391cf4ea18f18b10ed3585a91 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesActionsTest-1949514988 May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:02:42.583357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_e358a1e391cf4ea18f18b10ed3585a91", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesActionsTest-1949514988 May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: e358a1e391cf4ea18f18b10ed3585a91 May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesActionsTest-1949514988 May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesActionsTest-1949514988-project May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 9dc1b321e70f42e2be177e161486f997 May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesActionsTest-1949514988-project May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. May 26 18:02:42.584946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '1da1fee2-eaed-4950-962d-3ed6708a8f0d'} May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:02:42.585815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. May 26 18:02:42.588255 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:02:42.589403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Returning 404 to user: Instance 1da1fee2-eaed-4950-962d-3ed6708a8f0d could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:02:42.589403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b0efcb1d-f229-418c-9e07-92dd0c63c00d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d" status: 404 len: 111 microversion: 2.1 time: 0.031234 May 26 18:02:42.589403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 222/422] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:42 2022] GET /compute/v2.1/servers/1da1fee2-eaed-4950-962d-3ed6708a8f0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:02:42.702121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-158783922", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "networks": [{"uuid": "28b216ad-c369-43b9-b3a0-26ffaee2711e"}]}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:42.756872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] validate_networks() for [('28b216ad-c369-43b9-b3a0-26ffaee2711e', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:02:42.971724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:42.973069 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:42.987874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.987874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:42.987874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:42.987874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.226696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:43.234911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d3a79382-7118-41a6-a912-05da340d4652 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.268950 May 26 18:02:43.235712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 223/423] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:42 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:43.238027 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:02:43.238452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:02:43.239174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:02:43.239909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:02:43.240333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:02:43.250794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.251910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.252749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:43.253189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:43.270433 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Getting quotas for project e358a1e391cf4ea18f18b10ed3585a91. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:02:43.274454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Getting quotas for user 9dc1b321e70f42e2be177e161486f997 and project e358a1e391cf4ea18f18b10ed3585a91. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:02:43.285540 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:02:43.288167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:02:43.491926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-81ec8764-784c-4a57-a5f7-0bd2e0eddb37 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.793849 May 26 18:02:43.498724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 201/424] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:02:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 18:02:43.504136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dc7e00d6-1564-47f8-8e04-a82202ca6972 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:43.504926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dc7e00d6-1564-47f8-8e04-a82202ca6972 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:43.574725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dc7e00d6-1564-47f8-8e04-a82202ca6972 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:43.582197 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dc7e00d6-1564-47f8-8e04-a82202ca6972 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1217 microversion: 2.1 time: 0.081947 May 26 18:02:43.583102 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 224/425] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:43 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:44.253327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:44.253875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:44.262531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.263298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.263966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.264439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.403280 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:44.410779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-33d0fbd0-17a3-4412-9474-17cd5ea79ab6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.161367 May 26 18:02:44.411628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 202/426] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:44 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:44.608400 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:44.609033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:44.615352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.615804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.616588 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:44.617058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:44.682521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:44.690742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3c16193c-394f-4046-ae43-91f02f8e3119 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1221 microversion: 2.1 time: 0.086382 May 26 18:02:44.691341 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 225/427] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:44 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:45.430576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:45.431215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:45.438714 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.439269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.440136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.440656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.571562 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:45.580681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e25382bc-cc51-4912-ba72-c6f3630f288d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1374 microversion: 2.1 time: 0.154040 May 26 18:02:45.581286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 203/428] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:45 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:45.708136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:45.709058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:45.715834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.716289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.717114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:45.717556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:45.783313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:45.791167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-56c4de44-0185-4523-9449-a3ce3603721a tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1269 microversion: 2.1 time: 0.086923 May 26 18:02:45.792496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 226/429] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:45 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:46.604759 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.605621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.612952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.613518 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.614212 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.614685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.758046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:46.767789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-29b5027c-d2d4-45e6-a855-81c1b5472448 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1567 microversion: 2.1 time: 0.166867 May 26 18:02:46.768709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 204/430] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:46.797143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.799209 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.810728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:46.811391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:46.813315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.814125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.815812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.816805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.822362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.824896 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.826895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:46.827520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:46.941626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:46.949735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e9a7cd29-42d9-422d-b4cd-a66a077d310b tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1277 microversion: 2.1 time: 0.143010 May 26 18:02:46.950330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 205/431] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:46.966841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-43b10bd9-a95d-473c-b24b-5b566af838cd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176423 May 26 18:02:46.967316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 227/432] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:02:46 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:47.969274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:47.969893 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:47.977297 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.977779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:47.978762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:47.979189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.148952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:48.162259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7ee59bcc-fdbb-4aa7-8d4b-96a6eeae509d tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.194014 May 26 18:02:48.162259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 206/433] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:47 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:02:48.917581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-ced233bb-5cee-465c-b61e-65da8c32fc38 req-47471c4d-3e79-4036-8ed5-914584a0d3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:48.931116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-ced233bb-5cee-465c-b61e-65da8c32fc38 req-47471c4d-3e79-4036-8ed5-914584a0d3e0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:48.931637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-ced233bb-5cee-465c-b61e-65da8c32fc38 req-47471c4d-3e79-4036-8ed5-914584a0d3e0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:48.950024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-ced233bb-5cee-465c-b61e-65da8c32fc38 req-47471c4d-3e79-4036-8ed5-914584a0d3e0 service nova] Creating event network-changed:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:02:48.956826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-ced233bb-5cee-465c-b61e-65da8c32fc38 req-47471c4d-3e79-4036-8ed5-914584a0d3e0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 May 26 18:02:48.958467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 228/434] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:49.180218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:49.182382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:49.188548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:49.194612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.195654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.201797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:49.201797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:49.387519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:49.397594 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-284853b8-1fa3-4faf-b895-3395fa2967e5 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.224377 May 26 18:02:49.398656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 207/435] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:49 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:50.421520 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:50.422215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:50.428573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.429235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.429775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:50.430207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:50.569957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:50.577918 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c5ad00f8-95c8-458c-b7ec-a216f64c5af1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.161165 May 26 18:02:50.578589 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 229/436] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:50 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:51.230843 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-02d57d0a-5c60-4b16-9c98-b994be9f6851 req-1d54b14d-ac44-4fd9-bf4d-3b2e3c86443e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b32ace-7d95-419c-bf4a-554613b13fa9", "tag": "e9a1c03f-b884-4e67-8532-c5671bf9ab11"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:51.239249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-02d57d0a-5c60-4b16-9c98-b994be9f6851 req-1d54b14d-ac44-4fd9-bf4d-3b2e3c86443e service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.239686 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-02d57d0a-5c60-4b16-9c98-b994be9f6851 req-1d54b14d-ac44-4fd9-bf4d-3b2e3c86443e service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.250966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-02d57d0a-5c60-4b16-9c98-b994be9f6851 req-1d54b14d-ac44-4fd9-bf4d-3b2e3c86443e service nova] Creating event network-changed:e9a1c03f-b884-4e67-8532-c5671bf9ab11 for instance c7b32ace-7d95-419c-bf4a-554613b13fa9 on hv-cinder-83607 May 26 18:02:51.255801 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-02d57d0a-5c60-4b16-9c98-b994be9f6851 req-1d54b14d-ac44-4fd9-bf4d-3b2e3c86443e service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029144 May 26 18:02:51.256371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 208/437] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:51.594871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:51.595665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:51.601587 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.602102 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.602957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:51.603394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:51.736020 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:51.743348 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-19802e2c-f3a2-426b-a663-504851c34bd1 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.152362 May 26 18:02:51.743907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 230/438] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:51 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:52.762887 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:52.763612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:52.769888 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.770340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:52.771163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:52.771601 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:52.906137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:52.913784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-808f3575-02b4-4941-90aa-0c5c1cb5132e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.156424 May 26 18:02:52.914350 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 209/439] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:52 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:53.294956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64040d60-a630-4c9d-b639-54fe21f408c0", "device": "/dev/sdb"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:53.296515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:53.302386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.302870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.303686 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.304163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.306661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.579166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.931163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:53.931978 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:53.935061 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.935776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=6 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:02:53.941220 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.941674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:53.942458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:53.942927 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:54.086459 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:54.094097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-54997637-1944-431c-85b9-6f8f7047f1c7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.166798 May 26 18:02:54.094738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 210/440] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:53 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:54.654684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-afb43be5-7233-437a-87cf-329834c2c06b tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "POST /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.363581 May 26 18:02:54.655747 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 231/441] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:02:53 2022] POST /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8/os-volume_attachments => generated 194 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:55.112826 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:55.113483 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:55.120543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.121832 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.123111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:55.129147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:55.256835 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:55.265341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-328f7ed4-9eca-450a-9afd-381e66cb9782 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.156614 May 26 18:02:55.265940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 211/442] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:55 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:56.283561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:56.284190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:56.290677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.291170 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.291946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.292416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.432921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:56.441001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f1c00c00-3f96-42a3-8beb-8668838f78e7 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.162488 May 26 18:02:56.441582 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 232/443] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:56 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:56.546981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-8c80c62f-1836-4f40-b2d7-a4e083bc930f req-438b2c3b-19d6-4c9f-be7a-ffa6093a5a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b32ace-7d95-419c-bf4a-554613b13fa9", "name": "network-vif-plugged", "status": "completed", "tag": "e9a1c03f-b884-4e67-8532-c5671bf9ab11"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:02:56.554846 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-8c80c62f-1836-4f40-b2d7-a4e083bc930f req-438b2c3b-19d6-4c9f-be7a-ffa6093a5a46 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:56.555320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-8c80c62f-1836-4f40-b2d7-a4e083bc930f req-438b2c3b-19d6-4c9f-be7a-ffa6093a5a46 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:56.566217 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-8c80c62f-1836-4f40-b2d7-a4e083bc930f req-438b2c3b-19d6-4c9f-be7a-ffa6093a5a46 service nova] Creating event network-vif-plugged:e9a1c03f-b884-4e67-8532-c5671bf9ab11 for instance c7b32ace-7d95-419c-bf4a-554613b13fa9 on hv-cinder-83607 May 26 18:02:56.571080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-8c80c62f-1836-4f40-b2d7-a4e083bc930f req-438b2c3b-19d6-4c9f-be7a-ffa6093a5a46 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028479 May 26 18:02:56.571699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 212/444] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:02:57.458307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:57.458950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:57.465908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.466354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.467142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:57.467575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:57.593832 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:57.601168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-34777546-a535-4d36-a075-db20fd657a9e tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.146699 May 26 18:02:57.601729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 233/445] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:57 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:58.618499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:58.619515 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:58.626777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:58.627418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:58.628334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:58.628773 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:58.771132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:58.782241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fb70e107-b7ac-4b5f-9381-319427c11038 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1317 microversion: 2.1 time: 0.166729 May 26 18:02:58.782454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 213/446] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:58 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:02:59.798203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:02:59.798851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:02:59.805429 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:59.805876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:59.806647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:02:59.807108 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:02:59.945870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:02:59.954488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c1e9d298-c210-48e1-b742-510569125c92 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1501 microversion: 2.1 time: 0.160832 May 26 18:02:59.956773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 234/447] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:02:59 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:00.861108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:00.861667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:00.867834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.868287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.869437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:00.869606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:00.895168 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:03:01.221890 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3832bee1-81f5-4679-ab0f-ee5ba7b57c63 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 204 len: 0 microversion: 2.1 time: 0.364566 May 26 18:03:01.223000 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 214/448] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:03:00 2022] DELETE /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 18:03:01.231742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:01.232487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:01.239002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:01.239450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:01.240376 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:01.241091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:01.383512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:01.391186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9719c69a-1e03-418d-9067-af80baeecc49 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1507 microversion: 2.1 time: 0.163866 May 26 18:03:01.391760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 235/449] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:01 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:02.408496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:02.409188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:02.415949 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:02.416394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:02.417149 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:02.417586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:02.550595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:02.558313 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d3a47f94-c842-4410-932e-71a28e97d773 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1507 microversion: 2.1 time: 0.153983 May 26 18:03:02.558932 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 215/450] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:02 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:03.576126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:03.576897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:03.579385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=46 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:03.584106 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:03.584565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:03.585332 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:03.585964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:03.748533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc1b321e70f42e2be177e161486f997', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e358a1e391cf4ea18f18b10ed3585a91', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:03.751067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-2c738994-44a2-4915-b6f5-e28f45514271 req-ddd96c2a-6bcb-48d2-a718-99db04c58f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b32ace-7d95-419c-bf4a-554613b13fa9", "name": "network-vif-deleted", "tag": "e9a1c03f-b884-4e67-8532-c5671bf9ab11"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:03.756391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d4c8cf1-a478-4c3b-a877-b0e31ffe94e8 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 200 len: 1507 microversion: 2.1 time: 0.185008 May 26 18:03:03.756968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 236/451] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:03 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:03.759149 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2c738994-44a2-4915-b6f5-e28f45514271 req-ddd96c2a-6bcb-48d2-a718-99db04c58f6a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:03.759593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2c738994-44a2-4915-b6f5-e28f45514271 req-ddd96c2a-6bcb-48d2-a718-99db04c58f6a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:03.770626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-2c738994-44a2-4915-b6f5-e28f45514271 req-ddd96c2a-6bcb-48d2-a718-99db04c58f6a service nova] Creating event network-vif-deleted:e9a1c03f-b884-4e67-8532-c5671bf9ab11 for instance c7b32ace-7d95-419c-bf4a-554613b13fa9 on hv-cinder-83607 May 26 18:03:03.775571 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-2c738994-44a2-4915-b6f5-e28f45514271 req-ddd96c2a-6bcb-48d2-a718-99db04c58f6a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028592 May 26 18:03:03.776371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 216/452] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:03:04.773645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:04.774277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] [instance: c7b32ace-7d95-419c-bf4a-554613b13fa9] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:04.781942 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:04.782459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:04.783462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:04.783909 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:04.800391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] HTTP exception thrown: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Request method failure captured: May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 HTTP/1.1 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8B5ki7VLNBXCMJvjvgQtetFO6c6MYIqWeFbhYPujkkdFiXgw-KdkV3ZcERSulwTHEC71dv4vJPTmqDftGy0jzvFVlHi-Np4dwtbRc_92RYFRosficQTywLrYbxnziBSMRqVrAGrMI0h4K5kwyDZLUvTBJ-T3M0y0j3Z1vRgdlEF-nM May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: e358a1e391cf4ea18f18b10ed3585a91 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesActionsTest-1949514988 May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:03:04.801943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/e358a1e391cf4ea18f18b10ed3585a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_e358a1e391cf4ea18f18b10ed3585a91", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesActionsTest-1949514988 May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: e358a1e391cf4ea18f18b10ed3585a91 May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesActionsTest-1949514988 May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesActionsTest-1949514988-project May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 9dc1b321e70f42e2be177e161486f997 May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesActionsTest-1949514988-project May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. May 26 18:03:04.803577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'c7b32ace-7d95-419c-bf4a-554613b13fa9'} May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:03:04.804416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. May 26 18:03:04.805779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:04.810580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] Returning 404 to user: Instance c7b32ace-7d95-419c-bf4a-554613b13fa9 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:03:04.810580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b36ad3fa-be96-4bff-9b16-c3cf9dca4b11 tempest-VolumesActionsTest-1949514988 tempest-VolumesActionsTest-1949514988-project] 10.222.0.121 "GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9" status: 404 len: 111 microversion: 2.1 time: 0.033629 May 26 18:03:04.810580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 237/453] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:04 2022] GET /compute/v2.1/servers/c7b32ace-7d95-419c-bf4a-554613b13fa9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:03:09.451332 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:03:09.452038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:03:34.010674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:34.012680 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:34.017661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:34.018487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:34.025063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.026667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.026667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:34.026878 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:34.184735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lazy-loading 'services' on Instance uuid 08086f84-b944-467c-b7ae-3ed16c986ca8 {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:34.463918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8771a308-388e-480f-8a8f-2b3611c664fc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "DELETE /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8/os-volume_attachments/64040d60-a630-4c9d-b639-54fe21f408c0" status: 202 len: 0 microversion: 2.1 time: 0.454219 May 26 18:03:34.469819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 217/454] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:03:34 2022] DELETE /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8/os-volume_attachments/64040d60-a630-4c9d-b639-54fe21f408c0 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:03:36.756474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:36.757712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:36.760080 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:36.760962 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:36.771985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.771985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.771985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:36.771985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:36.820369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:03:37.151405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0e9fd1a5-1ffb-4c67-9538-660938368cf3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "DELETE /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 204 len: 0 microversion: 2.1 time: 0.398433 May 26 18:03:37.152782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 238/455] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:03:36 2022] DELETE /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:03:37.163652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:37.164903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:37.173250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.173785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.174981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:37.175630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:37.316424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:37.324555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cf12279b-d05e-4543-bf85-b63d7979a9c7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1516 microversion: 2.1 time: 0.166321 May 26 18:03:37.325357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 218/456] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:37 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:38.344323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:38.345096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:38.352142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.352901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.353860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:38.354304 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:38.505642 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:38.513503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-660306b5-9f9d-4d5f-b983-4b926434bc3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1516 microversion: 2.1 time: 0.174292 May 26 18:03:38.514057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 239/457] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:38 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:03:39.530959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:39.532104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:39.539197 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.539648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.540409 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:39.540843 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:39.921986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:39.931682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-45f47587-ce9a-4742-a1f7-4a96e4d51354 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1516 microversion: 2.1 time: 0.404548 May 26 18:03:39.932889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 219/458] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:39 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1516 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:40.899546 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-c6643ebf-b5c2-472b-9e14-7a1fa75ee344 req-e0754fe5-8fd2-4166-8468-a68ea9b016a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08086f84-b944-467c-b7ae-3ed16c986ca8", "name": "network-vif-deleted", "tag": "30cb6d11-16b7-42f0-bee7-4184d788ec10"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:40.908743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c6643ebf-b5c2-472b-9e14-7a1fa75ee344 req-e0754fe5-8fd2-4166-8468-a68ea9b016a0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.909183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c6643ebf-b5c2-472b-9e14-7a1fa75ee344 req-e0754fe5-8fd2-4166-8468-a68ea9b016a0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.920191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-c6643ebf-b5c2-472b-9e14-7a1fa75ee344 req-e0754fe5-8fd2-4166-8468-a68ea9b016a0 service nova] Creating event network-vif-deleted:30cb6d11-16b7-42f0-bee7-4184d788ec10 for instance 08086f84-b944-467c-b7ae-3ed16c986ca8 on hv-cinder-83607 May 26 18:03:40.925195 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-c6643ebf-b5c2-472b-9e14-7a1fa75ee344 req-e0754fe5-8fd2-4166-8468-a68ea9b016a0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 May 26 18:03:40.925972 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 240/459] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:40.948559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:40.949170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:40.956367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.956821 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:40.957581 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:40.958018 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:41.029185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:41.040558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6c61232a-b1c3-4b1e-b308-fb58b73c5aae tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 200 len: 1474 microversion: 2.1 time: 0.095666 May 26 18:03:41.045004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 220/460] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:40 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 1474 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:03:42.062521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:42.063263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 08086f84-b944-467c-b7ae-3ed16c986ca8] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:42.070093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.070538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.071336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:42.071770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:42.086465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] HTTP exception thrown: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Request method failure captured: May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 HTTP/1.1 May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8B_PnYhqbhpWGfgIjGtqpgXjIX5OKSZYa6X7ftKiv45aKUxhE4-kU1Ru_xcT5Lhl6B46tOjY99-cdeMMyI_TbhLwiotY3wnhIMcA2QanI5QQxpNKpXA4-M1ea7RSUEdk6CfpuiRLNlz_SgaBFmW1wy05OnKny4ul0dtWjq93KaiC6s May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: ed709461c5a0499abc1a9cc33a8f916d May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:03:42.088222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_ed709461c5a0499abc1a9cc33a8f916d", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: ed709461c5a0499abc1a9cc33a8f916d May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotTestJSON-1389650468-project May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 99f2374b551741f4bc602debd1df336b May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotTestJSON-1389650468-project May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. May 26 18:03:42.090724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '08086f84-b944-467c-b7ae-3ed16c986ca8'} May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:03:42.092342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. May 26 18:03:42.096311 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:03:42.098649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Returning 404 to user: Instance 08086f84-b944-467c-b7ae-3ed16c986ca8 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:03:42.098649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c5d1cd0f-3bdf-4091-bf4c-6c121a491184 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8" status: 404 len: 111 microversion: 2.1 time: 0.031606 May 26 18:03:42.098649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 241/461] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:03:42 2022] GET /compute/v2.1/servers/08086f84-b944-467c-b7ae-3ed16c986ca8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:03:48.370228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:48.370793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:48.378237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.380330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.380330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:48.380330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:48.402919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-69a5c795-d1d2-4170-b01f-2d2e32b6468e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/ips" status: 200 len: 153 microversion: 2.20 time: 0.036671 May 26 18:03:48.403492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 221/462] 10.222.0.121 () {60 vars in 1293 bytes} [Thu May 26 18:03:48 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:03:52.986878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:52.987431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:52.989960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:52.990602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:03:52.995446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.002772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.002772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:53.002772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:53.021307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1f65850d-e1ed-46ac-a90e-844ef8564ee3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.038545 May 26 18:03:53.021864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 242/463] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:03:52 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:03:56.881400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:56.881959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:56.888781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.891178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.891178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:56.891178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:56.919931 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lazy-loading 'flavor' on Instance uuid 33849f73-e433-4e48-947b-b1e14b3844ae {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:03:57.511692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-af013ab9-085e-4f8a-9ad5-abc4cec5ae59 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/action" status: 202 len: 0 microversion: 2.20 time: 0.634169 May 26 18:03:57.512308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 222/464] 10.222.0.121 () {62 vars in 1323 bytes} [Thu May 26 18:03:56 2022] POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/action => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:03:57.521840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:57.522460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:57.530016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.530512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:57.531308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:57.531752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:57.684999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:57.693615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:57.695148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:57.696305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-804224bb-edde-4a94-a771-b906f916f1d7 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.178789 May 26 18:03:57.696862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 243/465] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:03:57 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:58.716046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:58.716776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:58.723972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:58.724430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:58.725209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:58.725650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:58.862074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.870207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.871746 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:03:58.872921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-10b9c2de-9c3c-4cc2-8fa5-bde98be353a4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.161801 May 26 18:03:58.873469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 223/466] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:03:58 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:03:58.948288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d426a760-2e6d-41c9-8fa2-5b662636a614"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:03:58.949617 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:58.957360 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:58.957883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:58.958660 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:58.959118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.893733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:03:59.894390 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:03:59.900479 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.900917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:03:59.901667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:03:59.902099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:00.029933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.037961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.039429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:00.040846 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fd42728a-ee77-4482-8616-20e678f7e87b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.151744 May 26 18:04:00.041388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 224/467] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:03:59 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:01.059150 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:01.059768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:01.067076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:01.067561 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:01.068334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:01.068846 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:01.201386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:01.210113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:01.211659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:01.212878 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9fecba1e-2cda-4224-96b5-1b640c91d5f4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.157706 May 26 18:04:01.213437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 225/468] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:01 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:02.231173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:02.231797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:02.238989 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.239436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.240196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:02.240651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:02.368656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.376451 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.378163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:02.379336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a1c2d457-1690-45ae-9292-183102337372 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.151986 May 26 18:04:02.379886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 226/469] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:02 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:02.981676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-20c0e8cf-4d6e-43ce-bfea-a3386fb66be1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.037316 May 26 18:04:02.982237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 244/470] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:03:58 2022] POST /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments => generated 194 bytes in 4039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:03.397643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:03.398245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:03.404622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.405066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.405817 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:03.406249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:03.541186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.549179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.550833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:03.552024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4b27069f-2e2f-49bf-ba35-d30a05f59645 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.158293 May 26 18:04:03.552580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 227/471] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:03 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:03.994518 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1249679978", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "networks": [{"uuid": "601caa42-a769-40c8-9cae-3204fe1f04cb"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:04.045850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] validate_networks() for [('601caa42-a769-40c8-9cae-3204fe1f04cb', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:04.399058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:04.399508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:04.400012 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:04.400463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:04.400979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:04.410485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.410999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.411809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.412246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.429838 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Getting quotas for project ed709461c5a0499abc1a9cc33a8f916d. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:04.434297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Getting quotas for user 99f2374b551741f4bc602debd1df336b and project ed709461c5a0499abc1a9cc33a8f916d. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:04.444864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:04.447250 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:04.569207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:04.569770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:04.572202 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=23 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:04.576960 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.577414 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.578182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:04.578622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:04.582995 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:04.596332 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [5c13c955-5d24-45eb-ba2d-b77127b34e8e] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:04:04.724196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:04.732218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:04.733738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:04.734947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ed9d3950-08a5-4114-98a3-a2a0f46483d4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.169765 May 26 18:04:04.735497 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 228/472] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:04 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:05.604498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [5c13c955-5d24-45eb-ba2d-b77127b34e8e] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 37678. May 26 18:04:05.608480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7f998fc5-0ab4-4073-a828-130184e51d37 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.618744 May 26 18:04:05.609317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 245/473] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:04:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:04:05.619701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9d284f3e-c81f-47fa-80ed-bd6ddd2e5c5c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:05.621623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9d284f3e-c81f-47fa-80ed-bd6ddd2e5c5c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:05.680670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9d284f3e-c81f-47fa-80ed-bd6ddd2e5c5c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.685952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9d284f3e-c81f-47fa-80ed-bd6ddd2e5c5c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1223 microversion: 2.1 time: 0.070447 May 26 18:04:05.686985 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 229/474] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:05 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1223 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:05.753058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:05.753732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:05.760213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.760764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.761535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:05.761968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:05.899320 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.907272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.908782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:05.909974 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9bc5c5ec-49a9-4d5a-9248-43a7bd0dc72c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.160717 May 26 18:04:05.910579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 246/475] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:05 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:06.703185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:06.703801 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:06.711721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.712177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.713631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.713631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.776486 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:06.784201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-438c28f6-5bba-4d1f-8df3-24ff648357e2 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1227 microversion: 2.1 time: 0.084732 May 26 18:04:06.784769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 230/476] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:06 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1227 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:06.930901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:06.931518 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:06.938163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.938655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:06.939474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:06.939917 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.071316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.079406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.080897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.083073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2d11c011-274d-4782-99e2-f6fb0e53be17 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.156663 May 26 18:04:07.083472 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 247/477] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:06 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:07.805617 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:07.806237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:07.821105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.821784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.822587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:07.823110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:07.901918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:07.909674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-14167d1f-660a-470b-87cd-b7ab298fe6c9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1283 microversion: 2.1 time: 0.108896 May 26 18:04:07.910248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 231/478] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:07 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:08.110663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:08.111812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:08.119296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.120043 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.120881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.121319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.258368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.266261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.271046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:08.271046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ade15110-5f91-4ed1-8e7e-877978da6ddb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.171891 May 26 18:04:08.271046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 248/479] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:08 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:08.928472 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:08.929169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:08.935769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.936277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:08.938943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:08.938943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.068741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.076382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6a8c154b-5acf-42ca-b513-8045aef95bd4 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.152623 May 26 18:04:09.077098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 232/480] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:08 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:09.288537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:09.289805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:09.296997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.297459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.298277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.298719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.448559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.460348 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.462412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:09.463746 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a351d56a-6583-4419-a6aa-a415718ba6af tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.179723 May 26 18:04:09.482729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 249/481] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:09 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:09.674345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-055e0dba-113f-4d8c-86b5-10afc8501e19 req-9ac7e41d-6eac-4b6f-99c4-92aad0321f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083da314-e056-47b1-a68f-2893ba7f9a0c", "tag": "53c8de45-7feb-4492-bfdc-7514244d66f2"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:09.682880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-055e0dba-113f-4d8c-86b5-10afc8501e19 req-9ac7e41d-6eac-4b6f-99c4-92aad0321f8d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:09.683331 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-055e0dba-113f-4d8c-86b5-10afc8501e19 req-9ac7e41d-6eac-4b6f-99c4-92aad0321f8d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:09.694727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-055e0dba-113f-4d8c-86b5-10afc8501e19 req-9ac7e41d-6eac-4b6f-99c4-92aad0321f8d service nova] Creating event network-changed:53c8de45-7feb-4492-bfdc-7514244d66f2 for instance 083da314-e056-47b1-a68f-2893ba7f9a0c on hv-cinder-83607 May 26 18:04:09.699668 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-055e0dba-113f-4d8c-86b5-10afc8501e19 req-9ac7e41d-6eac-4b6f-99c4-92aad0321f8d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028997 May 26 18:04:09.700260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 233/482] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:10.094998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:10.095624 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:10.103954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.105192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.106260 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.106900 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.244957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.252244 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c7777325-108e-4835-84cd-ebacfca002d1 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.161200 May 26 18:04:10.252809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 250/483] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:10 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:10.486362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:10.486747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:10.494693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.495210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.496010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:10.496442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:10.641859 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.650452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.651970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:10.653116 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f1b1cbb8-caee-4d8c-9c02-d48b97d435f6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.172203 May 26 18:04:10.653672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 234/484] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:10 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:11.269617 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:11.270444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:11.276949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.277401 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.278169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.278600 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.411745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.419553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2d4981dd-c1c1-414a-9e3a-a56a2de7674d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.153816 May 26 18:04:11.420226 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 251/485] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:11 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:11.672441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:11.673077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:11.680376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.680883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.681665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:11.682106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:11.816606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.825348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.826875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:11.828045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4988149f-1b88-4fff-8ec2-78bfe8247cb4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.159491 May 26 18:04:11.828604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 235/486] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:11 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:12.437101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:12.437830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:12.444296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.444737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.445495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.445945 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.579691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.588009 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-849aba40-45d2-41ea-9cac-00388c2cde7f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.154614 May 26 18:04:12.588570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 252/487] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:12 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:12.846638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:12.847286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:12.854620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.855107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.855868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:12.856302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:12.984470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.992585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.994087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:12.995266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-82afd887-b365-459d-ad12-87400e8a6bbd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.152427 May 26 18:04:12.995812 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 236/488] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:12 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:13.605127 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:13.605744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:13.612226 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.612680 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.613444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:13.613881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:13.747879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:13.756094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2942433e-3aa7-4935-8d4f-ea4318592697 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.154817 May 26 18:04:13.756650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 253/489] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:13 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:14.013140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:14.013751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:14.020269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.020732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.021487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.021920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.158148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.167556 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.169056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.170279 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8b5aa8da-c05a-416d-95d6-148fefe78bd9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.160975 May 26 18:04:14.170851 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 237/490] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:14 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:14.773532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:14.774242 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:14.776430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:14.777094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:14.782588 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.783213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.783860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:14.784297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:14.922514 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:14.934403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ca3d1c29-fff9-46b1-849c-f223c0022c96 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.165265 May 26 18:04:14.934812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 254/491] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:14 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:15.189517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.190167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.196899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.197351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.198122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.198557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.327603 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.336052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.337580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:15.338884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1590f69d-1e48-48de-978b-eb2865e8a438 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.153415 May 26 18:04:15.339461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 238/492] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:15.943452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ea6ded5d-40ff-4c0a-bef9-bd0af5c1f971 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: .version_select at 0x7f4b898b3d30>, body: {"keypair": {"name": "tempest-keypair-1866135573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwwcbVq+UPg/9eScA6KaYf/Ziklvk6EdCH97yZiBI9xlYKwp25YU0+mMf7cvL1hWbQje4de7KXKBgDJsU6RxAT6rc8wgmqz71vpNHlKmQ/aO8Ta+rugm1MHeTKa4ARXYQ=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:15.949983 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:15.950863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:15.952950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:15.957802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.958845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.959594 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-ea6ded5d-40ff-4c0a-bef9-bd0af5c1f971 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:15.959888 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:15.960365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:15.963774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-ea6ded5d-40ff-4c0a-bef9-bd0af5c1f971 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:16.078702 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ea6ded5d-40ff-4c0a-bef9-bd0af5c1f971 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139446 May 26 18:04:16.079558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 255/493] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:04:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:16.095860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.111084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3a3d46a3-cfc2-4f7e-9e10-8ade142c6b8e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.158816 May 26 18:04:16.111084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 239/494] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:15 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:16.357647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:16.358262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:16.365214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.365937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.366744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:16.367280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:16.501409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.510523 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.512234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:16.513750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e9be72ac-603b-40e5-8853-af6866a51467 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.160065 May 26 18:04:16.514500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 256/495] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:16 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:17.126656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:17.127292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:17.134912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.135410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.136178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.136618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.281255 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:17.288950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ca5fd0e0-dddd-42b9-a9c7-fbd727aa03d7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.166091 May 26 18:04:17.289567 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 240/496] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:17 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:17.533478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:17.534096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:17.541329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.541783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.542556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:17.543040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:17.690457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:17.699020 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:17.700518 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:17.701705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1e3d4080-6fd7-40c2-b02a-99bf76c75153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.172156 May 26 18:04:17.702267 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 257/497] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:17 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:18.308860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:18.310402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:18.324083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.324818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.325490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.325943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.502230 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.510940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dcb227c9-5cb0-4441-b9e2-5712ff13c3ba tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.208538 May 26 18:04:18.511539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 241/498] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:18 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:18.720539 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:18.721990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:18.731929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.732554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.733503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:18.733953 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:18.884583 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.892884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.894396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:18.896116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2a770849-2ebf-43ab-9349-89bd7f608137 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.179125 May 26 18:04:18.896907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 258/499] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:18 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:18.921930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1525271884", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd0758f-2a58-48c2-a018-de67fccda659"}], "security_groups": [{"name": "tempest-securitygroup--394262091"}], "key_name": "tempest-keypair-1866135573", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:19.029916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] validate_networks() for [('ccd0758f-2a58-48c2-a018-de67fccda659', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:04:19.424538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:04:19.425156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:04:19.425471 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:04:19.425885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:04:19.426305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:04:19.437607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.438066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.439145 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.439611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.457782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:04:19.462738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:04:19.474072 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:04:19.476429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:04:19.528077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.528692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.534787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.535274 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.536041 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.536748 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.541234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:19.577097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ff4232f0-c3cd-4307-915e-9e02fbb38303 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.660107 May 26 18:04:19.577917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 242/500] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:04:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:04:19.588399 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-aed1879d-acb3-4495-8bd5-006b58dd107d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.589012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-aed1879d-acb3-4495-8bd5-006b58dd107d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.656506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-aed1879d-acb3-4495-8bd5-006b58dd107d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.663769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-aed1879d-acb3-4495-8bd5-006b58dd107d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1246 microversion: 2.1 time: 0.079194 May 26 18:04:19.673787 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 243/501] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:19.694995 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:19.702758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9ad48323-7225-4296-a5d3-3afd59753cfc tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.178430 May 26 18:04:19.703727 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 259/502] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:19.914873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:19.915527 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:19.922414 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.922900 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:19.923667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:19.924105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.068372 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.077075 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.078585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.079776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-efc75223-e639-4290-91e0-124727c672a1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.169088 May 26 18:04:20.080356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 244/503] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:19 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:20.681804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:20.683066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:20.689642 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.690116 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.690918 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.691356 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.719607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:20.720226 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:20.727211 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.731413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.731413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:20.731413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:20.754534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.764078 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-99e1127d-748b-4276-beb1-779aaa726f8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1250 microversion: 2.1 time: 0.087019 May 26 18:04:20.764658 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 260/504] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:20 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:20.859422 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:20.867354 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6911d351-2260-4596-a598-5e1050522df5 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.151446 May 26 18:04:20.867919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 245/505] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:20 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:04:21.107749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.112177 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.115081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.115536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.116307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.116774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.252407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.260979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.262470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.263695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f2e0b54e-ec67-4935-8952-7fe56566bcc9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.160604 May 26 18:04:21.264263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 261/506] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:21.781633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.782240 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.789511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.789965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.791254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.792436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.854554 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:21.871762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-82f9bad4-a7c9-4490-84fb-003a5edd872e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1306 microversion: 2.1 time: 0.093373 May 26 18:04:21.883460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 246/507] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:21.884685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:21.885320 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:21.899976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.901048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.902096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:21.902643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:21.998861 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-13914407-ff98-43bd-86e5-387baeaa693c req-c9fc4520-ec29-4ab6-9b52-5bdbb536eb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083da314-e056-47b1-a68f-2893ba7f9a0c", "name": "network-vif-plugged", "status": "completed", "tag": "53c8de45-7feb-4492-bfdc-7514244d66f2"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:22.011186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-13914407-ff98-43bd-86e5-387baeaa693c req-c9fc4520-ec29-4ab6-9b52-5bdbb536eb94 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.011830 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-13914407-ff98-43bd-86e5-387baeaa693c req-c9fc4520-ec29-4ab6-9b52-5bdbb536eb94 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.028931 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-13914407-ff98-43bd-86e5-387baeaa693c req-c9fc4520-ec29-4ab6-9b52-5bdbb536eb94 service nova] Creating event network-vif-plugged:53c8de45-7feb-4492-bfdc-7514244d66f2 for instance 083da314-e056-47b1-a68f-2893ba7f9a0c on hv-cinder-83607 May 26 18:04:22.034109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-13914407-ff98-43bd-86e5-387baeaa693c req-c9fc4520-ec29-4ab6-9b52-5bdbb536eb94 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041862 May 26 18:04:22.034960 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 247/508] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:04:22.074981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.088904 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-687b142c-be07-41af-b2a5-f2b3942784ea tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.209432 May 26 18:04:22.091668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 262/509] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:21 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:22.282883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:22.283584 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:22.290313 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.290771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.291818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.292261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.451080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.453500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:22.460379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.462065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:22.463502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-638814d8-6176-4c3f-88a0-9915809527b4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.184688 May 26 18:04:22.463826 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 248/510] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:22 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:22.889510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:22.890122 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:22.897529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.898001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:22.899022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:22.899638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.042791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.050392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9355b3d0-3477-41d7-864c-3c93eb1f774a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.164746 May 26 18:04:23.050912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 263/511] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:22 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:23.110423 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:23.111115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:23.118766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.119249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.120023 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.120461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.251257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.259750 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-df3b6d7e-a7a5-462a-a0b9-6c04540ae121 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.154674 May 26 18:04:23.260327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 249/512] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:23 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:23.481383 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:23.481994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:23.488078 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.488524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.489826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.490301 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.620819 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.629817 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.632502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:23.633962 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6ba3e9ab-ac42-4243-a942-b7eb2d554680 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.156520 May 26 18:04:23.635260 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 264/513] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:23 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:23.966318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-f544ea7c-f1b3-413b-b97a-56687b5c1577 req-fb631e62-daa1-44c1-95b4-94b4cc0a042d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee5f274-1ed9-4543-a4c3-fbc71cfe3453", "tag": "211aeb7e-8b4f-4080-899f-53eebc799203"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:23.981232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f544ea7c-f1b3-413b-b97a-56687b5c1577 req-fb631e62-daa1-44c1-95b4-94b4cc0a042d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:23.981232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f544ea7c-f1b3-413b-b97a-56687b5c1577 req-fb631e62-daa1-44c1-95b4-94b4cc0a042d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:23.997126 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-f544ea7c-f1b3-413b-b97a-56687b5c1577 req-fb631e62-daa1-44c1-95b4-94b4cc0a042d service nova] Creating event network-changed:211aeb7e-8b4f-4080-899f-53eebc799203 for instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 on hv-cinder-83607 May 26 18:04:24.002502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-f544ea7c-f1b3-413b-b97a-56687b5c1577 req-fb631e62-daa1-44c1-95b4-94b4cc0a042d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 May 26 18:04:24.003357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 250/514] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:24.070692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.071541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.087855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.087855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.087855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.087855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.225374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.233207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-75fc0bdc-e147-4f24-a584-d2186c04ce22 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.167449 May 26 18:04:24.233789 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 265/515] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:24.277809 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.278510 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.284845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.285300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.286066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.286557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.423742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.434062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dd310aca-159f-450f-b39b-937eac9ffb22 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1323 microversion: 2.1 time: 0.161031 May 26 18:04:24.434641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 251/516] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:24.652820 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:24.653440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:24.659382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.659826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.660577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:24.661007 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:24.792353 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.800212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.807117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:24.807117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bb63555d-705d-4322-9b28-20ab743c6aa1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.155319 May 26 18:04:24.807117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 266/517] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:24 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:25.251129 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:25.251746 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.258784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.259295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.260215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.260666 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.395195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.402649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b67ed024-325c-424f-9b28-e06a9c9c1fb5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.155607 May 26 18:04:25.403245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 252/518] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:25 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:25.451749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:25.452654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.460392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.460848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.461615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.462049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.600570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.608241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-66bbd5da-efd3-433c-b7be-09a07cebe1a7 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1512 microversion: 2.1 time: 0.160337 May 26 18:04:25.608824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 267/519] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:25 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:25.625596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f47a2b6-77e3-4bc1-b5ae-a6972b3f49ad", "device": "/dev/sdb"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:25.627299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.634690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.635430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.636214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.636654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.824591 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:25.825965 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:25.832013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.832465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.833275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.833897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:25.972177 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.974645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:25.981294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.982791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:25.984051 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b017af6d-cc16-4169-8014-6aa700800b3d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.166439 May 26 18:04:25.984851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 268/520] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:25 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:25.989054 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-c8ba4752-37b4-4f6a-9e16-ad1d94802567 req-be154d0f-90b4-4132-b238-769bfbca58bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "name": "network-vif-plugged", "status": "completed", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:25.998467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c8ba4752-37b4-4f6a-9e16-ad1d94802567 req-be154d0f-90b4-4132-b238-769bfbca58bc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:25.998946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-c8ba4752-37b4-4f6a-9e16-ad1d94802567 req-be154d0f-90b4-4132-b238-769bfbca58bc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.011465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-c8ba4752-37b4-4f6a-9e16-ad1d94802567 req-be154d0f-90b4-4132-b238-769bfbca58bc service nova] Creating event network-vif-plugged:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:04:26.016677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-c8ba4752-37b4-4f6a-9e16-ad1d94802567 req-be154d0f-90b4-4132-b238-769bfbca58bc service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030969 May 26 18:04:26.017433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 269/521] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:26.332794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ae45c54b-a5fc-4f0e-8697-4d7318348c60 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "POST /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711067 May 26 18:04:26.334083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 253/522] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:04:25 2022] POST /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:26.421389 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:26.422086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:26.430201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.430201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.430925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:26.431364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:26.560460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:26.568368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b3cb9d03-59df-410a-b2b1-6b968753b231 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.150608 May 26 18:04:26.569040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 270/523] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:26 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:27.004394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:27.005111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:27.011612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.012066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.012837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.013323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.146342 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.155877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.157042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-53d4271b-cf80-437e-a3ba-8ff9b7464ec1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.157493 May 26 18:04:27.157588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 254/524] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:26 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:27.586336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:27.587005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:27.593722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.594167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.594966 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:27.595426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:27.726334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:27.733914 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-33e4edc5-90bc-4cad-ab0f-75a7f24a7850 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.152282 May 26 18:04:27.734483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 271/525] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:27 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:28.175684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:28.176296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:28.183445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.183901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.184672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.185116 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.315933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.324047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.325490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.326647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3cbd9955-8c45-40c7-a911-62861c4bef2a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1751 microversion: 2.20 time: 0.154866 May 26 18:04:28.327243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 255/526] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:28 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:28.751081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:28.751676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:28.759028 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.759475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.760234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:28.760667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:28.891774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:28.899709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a0eda023-2bb8-4aae-9b67-240c56c12db7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.152509 May 26 18:04:28.900271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 272/527] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:28 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:29.347668 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:29.348502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:29.355533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.366474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.366474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.366474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.448797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:29.495594 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.507039 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.521206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:29.521206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4e11733f-ae66-491e-80ef-a83f7eb31fe3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.166160 May 26 18:04:29.521206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 256/528] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:29 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:29.918942 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:29.920590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:29.925780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:29.931435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.934372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:29.934372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:29.934372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.121007 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.123844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f15b67fa-5f7d-4edb-a98e-363d13f1cda5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.210713 May 26 18:04:30.124427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 273/529] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:29 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:30.528808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:30.529408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:30.537630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:30.540972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.541690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.542474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:30.542936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:30.696289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.705436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.707208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:30.708723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6e6ac0b7-11db-46d3-a215-bab07c80a661 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.183739 May 26 18:04:30.709751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 257/530] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:30 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:31.141881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:31.142603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:31.149839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.150381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.151388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.151905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.291911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:31.299553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e63af3bb-c4a1-4971-ac42-273d1067df16 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.161961 May 26 18:04:31.310655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 274/531] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:31 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:31.728837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:31.733051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:31.736613 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.737343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.738299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:31.738745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:31.885137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:31.894042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:31.905378 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:31.913727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-030d23e9-a826-4125-a8f6-cd7c802e868c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.181945 May 26 18:04:31.913727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 258/532] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:31 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:04:32.093880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-8ba45a94-1243-45b8-8693-243d7825727b req-43156e9c-1abf-4fb4-887b-05c096df3110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee5f274-1ed9-4543-a4c3-fbc71cfe3453", "name": "network-vif-plugged", "status": "completed", "tag": "211aeb7e-8b4f-4080-899f-53eebc799203"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:32.111562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-8ba45a94-1243-45b8-8693-243d7825727b req-43156e9c-1abf-4fb4-887b-05c096df3110 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.112118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-8ba45a94-1243-45b8-8693-243d7825727b req-43156e9c-1abf-4fb4-887b-05c096df3110 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:32.127759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-8ba45a94-1243-45b8-8693-243d7825727b req-43156e9c-1abf-4fb4-887b-05c096df3110 service nova] Creating event network-vif-plugged:211aeb7e-8b4f-4080-899f-53eebc799203 for instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 on hv-cinder-83607 May 26 18:04:32.133380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-8ba45a94-1243-45b8-8693-243d7825727b req-43156e9c-1abf-4fb4-887b-05c096df3110 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049105 May 26 18:04:32.134025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 275/533] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:32.316907 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:32.318599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:32.325435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.325994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:32.327072 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.328448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:32.487920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:32.496389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c2dfc40d-a652-4e79-ae64-31182f771212 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.183301 May 26 18:04:32.496961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 259/534] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:32 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:32.925929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:32.926611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:32.934042 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.934485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:32.935277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:32.935717 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.069443 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.077404 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.078925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.080085 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4bd8d005-0da9-4554-8c2c-6af633854959 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.158740 May 26 18:04:33.080647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 276/535] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:32 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:33.513536 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:33.514179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:33.520883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.521617 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.522405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:33.523052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:33.683670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:33.691874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-762c7587-52cf-4cf8-acdd-89510f4d3679 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.182157 May 26 18:04:33.693379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 260/536] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:33 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:34.097445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:34.099067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:34.106627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.107038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.108054 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.108668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.113242 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:34.457307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.468823 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.470634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.471926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1d43d758-2fa0-401c-86fa-043f37f7c18a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.378397 May 26 18:04:34.472484 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 277/537] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:34 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:34.710429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:34.712941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:34.717516 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:34.725490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.726500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.726856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:34.727521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:34.889477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:34.900486 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-71a149e8-6f0d-4337-950e-ef9da1869d7d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1371 microversion: 2.1 time: 0.194014 May 26 18:04:34.901067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 261/538] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:34 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:35.491686 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:35.492495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:35.500011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.500555 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.501409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.501918 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.702561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:35.713320 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:35.715521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:35.716923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d415257a-b5ab-4f8f-aa1d-726653ff3d93 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.229247 May 26 18:04:35.717880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 278/539] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:35 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:35.919530 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:35.920148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:35.927559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.928014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:35.928782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:35.929235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.110424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:36.110424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f445c11c-e9ee-4e92-9a35-40efa422d877 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1560 microversion: 2.1 time: 0.156925 May 26 18:04:36.110424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 262/540] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:35 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:36.119549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:36.120026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:36.126178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.126629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.127427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.127973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.207542 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8a31adbc-7154-45cb-b024-7cadd2751018 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089521 May 26 18:04:36.208696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 279/541] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:04:36 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:36.739373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:36.740706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:36.754324 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.757187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:36.758254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:36.759546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.058613 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.071659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.073502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:37.074956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-70f2435a-4414-4521-aa77-b9c0a9f19b87 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.340865 May 26 18:04:37.075710 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 263/542] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:36 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:37.652492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-62393b2c-213e-4b0c-aa57-58ea49a2af79 req-247744f9-40b4-4fcb-829f-75e5ee87a509 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee5f274-1ed9-4543-a4c3-fbc71cfe3453", "tag": "211aeb7e-8b4f-4080-899f-53eebc799203"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:37.669258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-62393b2c-213e-4b0c-aa57-58ea49a2af79 req-247744f9-40b4-4fcb-829f-75e5ee87a509 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:37.670117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-62393b2c-213e-4b0c-aa57-58ea49a2af79 req-247744f9-40b4-4fcb-829f-75e5ee87a509 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:37.694655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-62393b2c-213e-4b0c-aa57-58ea49a2af79 req-247744f9-40b4-4fcb-829f-75e5ee87a509 service nova] Creating event network-changed:211aeb7e-8b4f-4080-899f-53eebc799203 for instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 on hv-cinder-83607 May 26 18:04:37.699918 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-62393b2c-213e-4b0c-aa57-58ea49a2af79 req-247744f9-40b4-4fcb-829f-75e5ee87a509 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051579 May 26 18:04:37.701284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 280/543] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:38.101856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:38.105336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:38.121747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.122502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.123505 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:38.123947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:38.326623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.330613 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:38.340166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.354447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:38.354447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6bb9ac97-2053-4773-9038-8385f03eb435 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.246863 May 26 18:04:38.355252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 264/544] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:38 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:39.362845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:39.363530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:39.371801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.372254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.373046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:39.373486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:39.676416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.684871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.686365 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:39.687573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3536058e-1f06-4cfe-bce8-b0b7f778d825 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.329278 May 26 18:04:39.688121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 281/545] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:39 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:40.705689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:40.706296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:40.713859 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.714491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.715290 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:40.715988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:40.912736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:40.923110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:40.923110 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:40.924195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7c5163c5-81c8-4ed9-adac-50d0d01b5a9c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.222652 May 26 18:04:40.924776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 265/546] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:40 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:41.943344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:41.943884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:41.950335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:41.950787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:41.951576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:41.952013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:42.084284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.092647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.094200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:42.095388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-edf91611-d2ae-4f85-b04b-6a37106ca9d5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.156234 May 26 18:04:42.095946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 282/547] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:41 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:43.113524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:43.114215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:43.121477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.121933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.122696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:43.123163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:43.248701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.257278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.258796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:43.259989 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-983e9914-e2b9-44bf-a8be-31701f2858d1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1746 microversion: 2.20 time: 0.150481 May 26 18:04:43.260543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 266/548] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:43 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:44.279109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:44.279716 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:44.286606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.287091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.287879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:44.288323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:44.424786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.434004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.435573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:44.436736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8bed378c-9fbd-4f62-aa25-29aedcfd59db tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.161625 May 26 18:04:44.437298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 283/549] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:44 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:45.455947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:45.456548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:45.463721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.464175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:45.464941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:45.465381 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:45.790854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:45.799075 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:45.800569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:45.801711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b6c1b57b-8a60-41cd-bba7-79f573b4f8ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.349664 May 26 18:04:45.802261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 267/550] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:45 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:46.820570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:46.822076 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:46.828849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.829297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.830063 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:46.830508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:46.957872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.966271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.967831 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:46.969049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-879f1b5b-80ef-4022-b09b-0ad46673c383 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.152475 May 26 18:04:46.969613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 284/551] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:46 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:47.988168 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:47.988788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:47.995496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.995950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:47.996719 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:47.997161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.131988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.140611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.142108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:48.143272 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0c68e40d-4be7-432c-8608-4897b28b28f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.159058 May 26 18:04:48.143819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 268/552] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:47 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:48.593348 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-9e296e50-34c0-4dfa-9f3a-6185484a89f4 req-47afcc6a-c7ae-4866-a88d-2cf8546daf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "name": "network-vif-unplugged", "status": "completed", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:48.602534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-9e296e50-34c0-4dfa-9f3a-6185484a89f4 req-47afcc6a-c7ae-4866-a88d-2cf8546daf30 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:48.603008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-9e296e50-34c0-4dfa-9f3a-6185484a89f4 req-47afcc6a-c7ae-4866-a88d-2cf8546daf30 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:48.614052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-9e296e50-34c0-4dfa-9f3a-6185484a89f4 req-47afcc6a-c7ae-4866-a88d-2cf8546daf30 service nova] Creating event network-vif-unplugged:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:04:48.619753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-9e296e50-34c0-4dfa-9f3a-6185484a89f4 req-47afcc6a-c7ae-4866-a88d-2cf8546daf30 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030163 May 26 18:04:48.620346 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 285/553] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:04:49.267802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:49.268509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:49.274970 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.275431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.276382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:49.276661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:49.415164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.424588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.426560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:49.427758 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-069bcc45-5925-4698-acc7-5a5cbcc880ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.270142 May 26 18:04:49.428320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 269/554] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:49 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:50.446993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:50.447692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:50.453994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.454450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.455243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:50.455680 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:50.589179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:50.597091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:50.598589 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:50.599759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f6af2cae-3d86-43bc-a25a-b31e1360697e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1728 microversion: 2.20 time: 0.157681 May 26 18:04:50.600316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 286/555] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:50 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:51.618884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:51.619531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:51.626980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.626980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.628349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.628349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.765990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.775640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.777189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:51.781004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d1869796-0283-4f88-be14-24a0e214d618 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1731 microversion: 2.20 time: 0.163628 May 26 18:04:51.781004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 270/556] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:51 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:51.797508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a50377-2d1d-4061-be4b-461804ad1038"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:51.798571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:51.806564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.810534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:51.810534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:51.810534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.006477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1ec04010-1cff-40a1-baea-ad1bfd1c6b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.213053 May 26 18:04:53.007173 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 287/557] 10.222.0.121 () {62 vars in 1368 bytes} [Thu May 26 18:04:51 2022] POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments => generated 188 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:04:53.125737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:04:53.126418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:53.132841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.133780 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.134547 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.135001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.438356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2fcf7b34-bece-4224-9433-85e1b61276ca tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/action" status: 202 len: 0 microversion: 2.20 time: 0.316329 May 26 18:04:53.438906 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 271/558] 10.222.0.121 () {62 vars in 1323 bytes} [Thu May 26 18:04:53 2022] POST /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:04:53.447907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:53.448527 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:53.454883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.455340 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.456183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:53.456618 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:53.589513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.598067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.599627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:53.601003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0e56ab63-eadd-454f-afb1-39bf08c37838 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1757 microversion: 2.20 time: 0.157961 May 26 18:04:53.601524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 288/559] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:53 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:54.620077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:54.620691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:54.627066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.627519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.628347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.628890 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.771506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.780736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.782238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:54.783421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ceaf5cb2-c6a5-414b-ba38-da28fa4f6ff2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1757 microversion: 2.20 time: 0.168360 May 26 18:04:54.783975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 272/560] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:54 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:54.978137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:54.978726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:54.985241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.985694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:54.986460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:54.986934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.111452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lazy-loading 'services' on Instance uuid 083da314-e056-47b1-a68f-2893ba7f9a0c {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:04:55.607848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9e4cae61-8f81-4442-bfc7-a7b166c3b812 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "DELETE /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c/os-volume_attachments/2f47a2b6-77e3-4bc1-b5ae-a6972b3f49ad" status: 202 len: 0 microversion: 2.1 time: 0.634041 May 26 18:04:55.608970 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 289/561] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:04:54 2022] DELETE /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c/os-volume_attachments/2f47a2b6-77e3-4bc1-b5ae-a6972b3f49ad => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:04:55.804027 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:55.804862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:55.813168 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.813639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.814425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:55.814904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:55.947507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:55.955796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:55.957299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:55.958452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c621ae5f-e5f6-4358-87e5-1c38cf0556ed tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1759 microversion: 2.20 time: 0.158804 May 26 18:04:55.959052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 273/562] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:55 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1759 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:56.977143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:56.977866 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:56.985172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:56.985624 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:56.993160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:56.993160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:57.143210 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.151974 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.153954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:57.154775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e39672da-6a2d-4971-8437-ca4c1ac38221 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1759 microversion: 2.20 time: 0.182009 May 26 18:04:57.156375 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 290/563] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:56 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1759 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:58.173244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:58.173858 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:58.181648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.182108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.182951 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.183400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.323233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.331744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.333248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:58.334622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b3eda0c0-7275-4646-8234-7f090f7efd6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.165391 May 26 18:04:58.335214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 274/564] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:58 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:04:58.838741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:58.839341 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:58.848058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.848511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.849284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:58.849721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:58.876319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:04:58.890145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:04:59.237970 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2be83c3d-8b14-4246-80be-62bb2bc4008c tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "DELETE /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 204 len: 0 microversion: 2.1 time: 0.403325 May 26 18:04:59.238559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 291/565] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:04:58 2022] DELETE /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:04:59.246443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:59.247095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:59.253554 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.254006 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:59.254767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.255239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:59.354927 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:04:59.356637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:04:59.367383 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.368766 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:59.370151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:04:59.370810 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:04:59.405807 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.413306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d30026e0-d930-4f14-b802-e6f13f3bfb61 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.170549 May 26 18:04:59.414250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 275/566] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:04:59 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:04:59.514521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.523541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.525356 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:04:59.526497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-12724e32-6473-4bea-ac27-4c8d920e238c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.176666 May 26 18:04:59.527122 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 292/567] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:04:59 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:00.432166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.432786 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.439209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.439665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.440458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.440897 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.544850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:00.545570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:00.552221 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.552750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.553591 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:00.554110 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:00.571692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.579432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d0f02007-1135-4462-a2cf-e6278945583a tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.151293 May 26 18:05:00.580092 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 276/568] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:00 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:00.712815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.721634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.723359 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:00.724540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c98febbf-a841-420e-a55b-870d13962425 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.183884 May 26 18:05:00.735778 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 293/569] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:00 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:01.597281 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:01.597884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:01.605555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.606004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.606802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.607489 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.734560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.742010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2be163f6-3095-4333-bc10-954554bc1684 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.148747 May 26 18:05:01.742689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 277/570] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:01 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:01.743791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:01.744468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:01.746945 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:01.751923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.752380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.753217 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:01.753692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:01.893804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.903815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.905328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:01.906489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e1424f76-2451-4de4-9b49-1ad390620a8f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.166903 May 26 18:05:01.907090 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 294/571] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:01 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:02.759429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:02.760010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:02.767086 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.767528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.768305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.768749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.901447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:02.914021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-90dfba92-def0-4cb4-be52-6e901d754c7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.158684 May 26 18:05:02.914802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 278/572] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:02 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:02.925407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:02.926114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:02.933511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.933961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:02.934738 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:02.935204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.068572 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.077294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.078782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:03.079947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2220a8e4-7323-4904-9f29-e2aeffc67617 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.158400 May 26 18:05:03.080500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 295/573] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:02 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:03.932716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:03.933432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:03.940927 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.941376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:03.942147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:03.942583 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.087719 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.096096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-93219187-10d7-46b4-9f89-9d2138be4cb9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.167714 May 26 18:05:04.097047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 279/574] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:03 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:04.097818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:04.098438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:04.105705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.106164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.106983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:04.107461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:04.248026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.256336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.257839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:04.259128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8a08c9c3-2e71-4c07-86d3-9d356b4ef470 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.165062 May 26 18:05:04.259689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 296/575] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:04 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:05.113681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:05.114294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:05.121132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.121576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.122349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.122772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.138472 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:05.261922 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.269764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-50d551e5-77a4-409e-871a-21ab3a6298a9 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.159914 May 26 18:05:05.270332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 280/576] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:05 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:05.279258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:05.279891 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:05.286466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.286979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.287789 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:05.288230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:05.426706 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.436410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.437898 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:05.439083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c8a03657-6a85-4955-ac50-32df494f4d64 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.164329 May 26 18:05:05.439642 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 297/577] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:05 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:06.288228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:06.288799 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:06.294444 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=42 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:06.307066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.307066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.307066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.307066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.457486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:06.458088 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:06.463774 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:06.464872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.465328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.466105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:06.466544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:06.471619 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b99ed405-e5c6-4b7c-a1b1-7d6efe762f3f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.187636 May 26 18:05:06.472104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 281/578] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:06 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:06.605541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:06.613933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:06.615459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:06.616605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ea2ecd07-cba6-44ba-8bc9-2f37f47795e8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.163037 May 26 18:05:06.617176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 298/579] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:06 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:07.489722 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:07.490627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:07.497474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.497931 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.498697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.499167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.635489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:07.636162 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:07.636471 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.643079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.643524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.644190 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8731028c-7882-4912-824c-7f2871e6d6bb tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.158519 May 26 18:05:07.644346 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:07.644719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:07.645144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 282/580] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:07 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:07.803960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.809952 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.811721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:07.812887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2ae7cd58-82de-45dd-a50d-a3dbc16c6000 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.181926 May 26 18:05:07.814153 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 299/581] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:07 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:07.979863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:05:07.980169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:05:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:05:08.668870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:08.669684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:08.679165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.679359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.680098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.680545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.827638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:08.833099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:08.833740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:08.841824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.842192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.843183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:08.843652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:08.844563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c6c946b5-1489-4175-a442-39b8d1d13999 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.180534 May 26 18:05:08.845457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 283/582] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:08 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:09.004046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:09.015736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:09.017315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:09.018546 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4b9d7abf-2c16-40b0-87f3-9f055202b18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.189775 May 26 18:05:09.019213 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 300/583] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:08 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:09.872234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:09.872863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:09.881586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:09.882189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:09.883268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:09.883716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.027137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:10.037320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7666b25f-eaa4-4568-a13d-b1fb733ea2f0 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.168962 May 26 18:05:10.037554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:10.038065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:10.049514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 284/584] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:09 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:10.051109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:10.051559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.052327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:10.052787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:10.229044 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:10.239688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:10.243484 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:10.244933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1914b1ee-1a8a-4318-8f37-d40900fcb400 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.211416 May 26 18:05:10.245815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 301/585] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:10 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:11.058486 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:11.059146 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:11.065620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:11.066064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:11.066838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:11.067283 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:11.203724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:11.211135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a6a1300b-2a9a-44b8-a2c6-cbfb4863149d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.158230 May 26 18:05:11.211696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 285/586] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:11 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:11.264189 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:11.265083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:11.271317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:11.271770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:11.272541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:11.272988 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:11.409318 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:11.418422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:11.419942 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:11.421083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8bd0a6d7-a8fa-4c5c-811f-0db3a5ae0c5d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.160745 May 26 18:05:11.421635 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 302/587] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:11 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:12.228383 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:12.228984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:12.235697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:12.236145 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:12.236993 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:12.237431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:12.383732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:12.391968 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-23342c7c-ef33-468b-b12c-06db119c0a5f tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.167726 May 26 18:05:12.392544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 286/588] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:12 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:12.439212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:12.439796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:12.446227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:12.446814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:12.447608 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:12.448045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:12.576598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:12.585054 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:12.586579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:12.587758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f84b79ca-6e57-424a-afc2-bf21506838bf tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.152487 May 26 18:05:12.588308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 303/589] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:12 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:13.409212 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:13.409830 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:13.416435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.416886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.417654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.418347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.547604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:13.555114 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9186e3c7-471c-4dc2-ac87-e64299065116 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.149727 May 26 18:05:13.555688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 287/590] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:13 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:13.605401 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:13.606008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:13.612552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.612984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.613744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:13.614179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:13.751796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:13.760684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:13.762203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:13.763369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-622c1d6c-43c5-4233-9aa4-078c967623a9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.161841 May 26 18:05:13.763922 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 304/591] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:13 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:14.572705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:14.573298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:14.579868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.580320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.581090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.581528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.718532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:14.726286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5145d538-5e01-4c83-bb63-51bf5069b73e tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.157475 May 26 18:05:14.726976 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 288/592] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:14 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:14.781794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:14.782398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:14.789026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.789478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.790867 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:14.791295 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:14.930223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:14.939578 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:14.941089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:14.942249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a6fa8997-9df7-47e5-93de-42d7fedd9248 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.164423 May 26 18:05:14.942813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 305/593] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:14 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:15.743852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:15.744577 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:15.751192 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.751674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.752447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.752879 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.899647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:15.907918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b9031882-5d80-4bdf-a9aa-35ebffcc3a7d tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1518 microversion: 2.1 time: 0.168066 May 26 18:05:15.908655 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 289/594] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:15 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:15.962453 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:15.963225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:15.970798 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.971273 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:15.972067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:15.972524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.108783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:16.117806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:16.120125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:16.121499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-065c96c7-5183-49cd-8838-a4033df3a9ae tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.163858 May 26 18:05:16.122180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 306/595] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:15 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:16.925109 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:16.937431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:16.937431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.937431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.937431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.938171 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.938171 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:16.975386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-3a87b224-89c6-41de-a187-6e362a5043ef req-4bf31de2-4059-4386-b6f8-0307522076de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083da314-e056-47b1-a68f-2893ba7f9a0c", "name": "network-vif-deleted", "tag": "53c8de45-7feb-4492-bfdc-7514244d66f2"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:16.984621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-3a87b224-89c6-41de-a187-6e362a5043ef req-4bf31de2-4059-4386-b6f8-0307522076de service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:16.985058 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-3a87b224-89c6-41de-a187-6e362a5043ef req-4bf31de2-4059-4386-b6f8-0307522076de service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:16.997308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99f2374b551741f4bc602debd1df336b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed709461c5a0499abc1a9cc33a8f916d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.002469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-3a87b224-89c6-41de-a187-6e362a5043ef req-4bf31de2-4059-4386-b6f8-0307522076de service nova] Creating event network-vif-deleted:53c8de45-7feb-4492-bfdc-7514244d66f2 for instance 083da314-e056-47b1-a68f-2893ba7f9a0c on hv-cinder-83607 May 26 18:05:17.005968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a2f98dbb-2664-4b70-bd70-c75aa7265fe3 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 200 len: 1476 microversion: 2.1 time: 0.084722 May 26 18:05:17.011917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-3a87b224-89c6-41de-a187-6e362a5043ef req-4bf31de2-4059-4386-b6f8-0307522076de service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100094 May 26 18:05:17.013466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 290/596] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:17.014960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 307/597] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:16 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 1476 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:17.143745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:17.147316 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:17.151703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.152147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.152917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:17.153374 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:17.289254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.298781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.300340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:17.301492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b4b80df5-1aac-47ba-afa4-5452a783a1b6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.161964 May 26 18:05:17.302044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 291/598] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:17 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:18.024459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:18.025054 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] [instance: 083da314-e056-47b1-a68f-2893ba7f9a0c] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:18.033227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.033679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.034446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.034924 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.049774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] HTTP exception thrown: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Request method failure captured: May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c HTTP/1.1 May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8B_PnYhqbhpWGfgIjGtqpgXjIX5OKSZYa6X7ftKiv45aKUxhE4-kU1Ru_xcT5Lhl6B46tOjY99-cdeMMyI_TbhLwiotY3wnhIMcA2QanI5QQxpNKpXA4-M1ea7RSUEdk6CfpuiRLNlz_SgaBFmW1wy05OnKny4ul0dtWjq93KaiC6s May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: ed709461c5a0499abc1a9cc33a8f916d May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:05:18.051449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/ed709461c5a0499abc1a9cc33a8f916d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_ed709461c5a0499abc1a9cc33a8f916d", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: ed709461c5a0499abc1a9cc33a8f916d May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1389650468 May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-VolumesSnapshotTestJSON-1389650468-project May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 99f2374b551741f4bc602debd1df336b May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-VolumesSnapshotTestJSON-1389650468-project May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. May 26 18:05:18.052892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '083da314-e056-47b1-a68f-2893ba7f9a0c'} May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:05:18.053714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. May 26 18:05:18.055298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:05:18.056612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] Returning 404 to user: Instance 083da314-e056-47b1-a68f-2893ba7f9a0c could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:05:18.056612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f0bbb766-246a-4aab-9902-da97329e7c38 tempest-VolumesSnapshotTestJSON-1389650468 tempest-VolumesSnapshotTestJSON-1389650468-project] 10.222.0.121 "GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c" status: 404 len: 111 microversion: 2.1 time: 0.032326 May 26 18:05:18.056612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 308/599] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:18 2022] GET /compute/v2.1/servers/083da314-e056-47b1-a68f-2893ba7f9a0c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:05:18.319435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:18.319976 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:18.326687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.327178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.327958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:18.328396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:18.467144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.475891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.477389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:18.478545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-02c90b69-d8e7-431c-8ba3-7a311cd59c35 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.163171 May 26 18:05:18.479172 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 292/600] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:18 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:19.498395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:19.499016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:19.505873 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.515612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.515612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:19.515612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:19.637719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.647357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.648999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:19.650233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e35af32c-1631-49fa-afe2-a38f661ed7d9 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.156988 May 26 18:05:19.650785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 309/601] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:19 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:20.669798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:20.670449 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:20.677111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:20.677559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:20.678385 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:20.678846 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:20.813306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:20.821851 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:20.823576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:20.824736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9636ca21-b4f3-4f3e-bbd3-fea9e1a62ab6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.159935 May 26 18:05:20.825435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 293/602] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:20 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:21.843149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:21.843845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:21.850335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.850922 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.851689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:21.852130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:21.987434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.996577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.998095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:21.999273 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-43226aa9-a7a8-4e21-ae39-b1471cb1b751 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.160130 May 26 18:05:21.999824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 310/603] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:21 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:23.018090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:23.018689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:23.025438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.025889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.026646 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:23.027757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:23.162043 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:23.170936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:23.172437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:23.173585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4e84ca16-55de-4df4-9f15-5910f84d51e1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.159386 May 26 18:05:23.174140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 294/604] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:23 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:24.194871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:24.195536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:24.203079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.203602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.204496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:24.205145 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:24.345016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.353529 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.355517 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:24.356665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-73f7ac37-1711-4b6f-a2e9-9b8493a1642f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.166855 May 26 18:05:24.357234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 311/605] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:24 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:25.374914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:25.375526 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:25.382815 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.383298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.384064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:25.384502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:25.516404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.526171 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.528665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:25.530066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4eef8a58-8c1a-4f46-a1a1-aee9b753c786 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.159017 May 26 18:05:25.530764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 295/606] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:25 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:26.548335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:26.548857 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:26.555393 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.555851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.556603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:26.557047 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:26.692374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:26.701977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:26.703511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:26.704754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2a7ed4c0-6544-45fc-b3a2-891a5f10ba74 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.160368 May 26 18:05:26.705313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 312/607] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:26 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:27.069853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e424c842-b647-4935-9ce1-5d9bb9deec4d"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:27.069853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:27.077480 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.077940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.078727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.079198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.723594 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:27.724227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:27.730406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.731368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.731987 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:27.732424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:27.819180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:27.875538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.884073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.885545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:27.887358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-31e01d83-4930-4053-bedc-d275033d9475 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.167634 May 26 18:05:27.888078 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 313/608] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:27 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:05:28.105382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3e855756-93f1-42ee-96f6-51959efa0681 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152847 May 26 18:05:28.106766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 296/609] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:05:26 2022] POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:28.855248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-a943983e-4f10-4e88-a070-473c35113c01 req-36530ffd-3350-4035-af66-615a4c07d2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "name": "network-vif-plugged", "status": "completed", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:28.863773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-a943983e-4f10-4e88-a070-473c35113c01 req-36530ffd-3350-4035-af66-615a4c07d2bb service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.864228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-a943983e-4f10-4e88-a070-473c35113c01 req-36530ffd-3350-4035-af66-615a4c07d2bb service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.875378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-a943983e-4f10-4e88-a070-473c35113c01 req-36530ffd-3350-4035-af66-615a4c07d2bb service nova] Creating event network-vif-plugged:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:05:28.880371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-a943983e-4f10-4e88-a070-473c35113c01 req-36530ffd-3350-4035-af66-615a4c07d2bb service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091801 May 26 18:05:28.880981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 314/610] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:05:28.907733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:28.908370 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:28.915080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.915752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:28.919833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:28.919833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:29.060209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:29.068700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:29.070195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:29.071384 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7af1d63a-7d7a-42ec-8080-751f3482b220 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.169542 May 26 18:05:29.071940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 297/611] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:28 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:30.098477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:30.099113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:30.109640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.110166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:30.111179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:30.111670 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:30.249988 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:30.258555 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:30.259937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:30.261088 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4ec5be3a-6c24-4737-a998-00a3b06a023d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.167647 May 26 18:05:30.261640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 315/612] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:30 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:31.280458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:31.281105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:31.287935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.288419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.289243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:31.289692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:31.427422 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.436689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.438184 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:31.439363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-011ef563-63f7-47ff-bc35-7147567f125b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.163051 May 26 18:05:31.439964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 298/613] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:31 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:32.458463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:32.459164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:32.461776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=44 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:32.466851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.467363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.468172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:32.468632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:32.603207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:32.612810 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:32.614391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:32.615745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4ec4434a-d677-4691-90d6-46cf66eb812b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.161435 May 26 18:05:32.616327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 316/614] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:32 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:33.639439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:33.640397 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:33.646704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.647177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.647944 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:33.648413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:33.777507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.786631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.788157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:33.789296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c5f59c9b-5937-40b6-9527-ba20cdd325a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.154036 May 26 18:05:33.789849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 299/615] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:33 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:34.808487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:34.809122 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:34.816117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.816604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.817339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:34.817776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:34.948327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.958023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.959664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:34.960870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dfa75096-8b0c-41eb-8d06-034e6f680155 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1815 microversion: 2.20 time: 0.156322 May 26 18:05:34.961477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 317/616] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:34 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1815 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:35.980445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:35.981029 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:35.988283 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.988729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:35.989487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:35.989922 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:36.134060 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:36.143320 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:36.144853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:36.146004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-95d0f17c-af8b-4b2a-b50d-a4adb72080f1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1802 microversion: 2.20 time: 0.169452 May 26 18:05:36.146547 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 300/617] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:05:35 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:05:38.804118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:05:38.805079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:38.812297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.812764 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.813523 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:38.813959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:38.837492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'flavor' on Instance uuid a5f8cbc1-6215-4f6e-922d-1080c7e893cf {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:05:39.300364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c87df182-4494-4bf9-845b-daedadc89cfe tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/action" status: 200 len: 32 microversion: 2.1 time: 0.500239 May 26 18:05:39.300966 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 318/618] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:05:38 2022] POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/action => generated 32 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:05:39.309919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:39.310558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:39.313931 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=40 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:39.318735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.319214 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.319982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:39.320419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:39.453809 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:39.462130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-08a4bb3e-82bf-4804-94ee-f2c3344a0964 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.155910 May 26 18:05:39.462715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 301/619] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:39 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:40.482603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:40.483522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:40.490239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.490690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.491511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:40.491951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:40.640383 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:40.648559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a26ea215-eb0a-46cf-a250-b15a8aed3dbc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.171134 May 26 18:05:40.649137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 319/620] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:40 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:41.666574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:41.667211 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:41.675012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.675465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.676286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:41.676723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:41.806189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:41.815344 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d3aff10f-0d74-4564-bdd5-e4a5f455c73d tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.152440 May 26 18:05:41.815850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 302/621] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:41 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:42.833336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:42.833943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:42.840554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.844881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.844881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:42.844881 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:42.970611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:42.978610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eb1f8635-1a78-422d-9e98-79e884ee57e0 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.149159 May 26 18:05:42.979203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 320/622] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:42 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:43.995853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:43.996464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:44.004020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.004474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.005239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:44.005677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:44.138142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:44.146179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8ca85866-5b81-4887-b11e-475565d32a7f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.154202 May 26 18:05:44.146748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 303/623] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:43 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:45.164333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:45.164997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:45.171982 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.174002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.174002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:45.174002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:45.302732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:45.310648 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-97862c35-d3a1-4413-a9f1-e7db79758e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.150585 May 26 18:05:45.311234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 321/624] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:45 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:46.328787 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:46.329332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:46.335745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.336216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.336980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:46.337408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:46.472588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:46.480582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0f626106-bc65-4087-9a01-3a3fc405ecc8 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.155813 May 26 18:05:46.481150 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 304/625] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:46 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:47.497448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:47.498149 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:47.505693 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.506219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.507079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:47.507513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:47.636755 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:47.644921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3659f8ed-a8ca-4631-8231-74e0dfd6b514 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.151384 May 26 18:05:47.645488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 322/626] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:47 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:48.662013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:48.662621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:48.668798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.669249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.670262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:48.670698 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:48.807852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:48.820816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7ee52623-6c68-4866-8ec6-ea96fe7ac354 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.162481 May 26 18:05:48.821441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 305/627] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:48 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:49.850035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:49.850647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:49.857418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.857874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.858651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:49.859114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:49.864291 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:05:50.001599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:50.009734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dae438e4-0b75-4cd9-9cec-dbecab7b70ca tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.163496 May 26 18:05:50.010322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 323/628] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:49 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:51.027419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:51.028616 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:51.036250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.036706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.037768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:51.038209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:51.167619 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:51.176573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4354c4d6-0e3d-4da8-8ac4-1d5ce6c2f605 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.153117 May 26 18:05:51.177134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 306/629] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:51 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:52.194517 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:52.195155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:52.201993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.202452 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.203285 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:52.203775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:52.336249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:52.344923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6652f9bd-9290-461e-a587-89581b85b1f2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.154599 May 26 18:05:52.345496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 324/630] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:52 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:05:53.362123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:53.362651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:53.369104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.371552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.371552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:53.371552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:53.500140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:53.508100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fe989a1e-812b-4c2a-b97a-c2a46af471d7 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.150465 May 26 18:05:53.508667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 307/631] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:53 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:54.525522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:54.526125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:54.532133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.532577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.533384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:54.534493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:54.667242 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:54.676482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c5aa00a4-a383-4fd5-a687-69e9c1c14bfc tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.154824 May 26 18:05:54.676973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 325/632] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:54 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:55.694005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:55.694591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:55.701132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.701579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.702335 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:55.702768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:55.832869 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:55.840903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9ee24731-d427-4c5b-a15d-c18398118be6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.151275 May 26 18:05:55.841496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 308/633] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:55 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:56.858048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:56.858653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:56.866211 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.866665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:56.867500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:56.867969 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:57.002342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:57.010681 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-38932838-abf6-4951-b8a9-b3d75e912e89 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.156704 May 26 18:05:57.011321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 326/634] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:56 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:58.029522 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:58.030130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:58.037121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.037572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.038329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:58.038762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:58.170260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:58.179301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-83f0878b-afdd-4978-bd1d-655f2659cad4 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.153579 May 26 18:05:58.179860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 309/635] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:58 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:05:59.197067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:05:59.197677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:05:59.204280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.204735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.205507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:05:59.206208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:05:59.335374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:05:59.343450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6c2cf631-8984-48f3-8b66-377745ba29da tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1738 microversion: 2.1 time: 0.150235 May 26 18:05:59.344023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 327/636] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:05:59 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:00.361355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:00.361949 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.368016 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.368462 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.369219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.369652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.372179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:00.498498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:00.507168 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3d9231d5-cf85-48c4-bd2f-20d28eba35ba tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1718 microversion: 2.1 time: 0.149917 May 26 18:06:00.507732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 310/637] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:00 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:00.609561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:00.610065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.617130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.617584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.618347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.618797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.700605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] HTTP exception thrown: Cannot 'detach_volume' instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf while it is in vm_state rescued May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Request method failure captured: May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments/e424c842-b647-4935-9ce1-5d9bb9deec4d HTTP/1.1 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8ATla5nyp_QRlNI0k-JA_Y0IggjggSnxXeVUTbGrptaHWmjHRxzuU404trg_8oO3HOT7VyFf3EyUgqOHBj4zYl4YnXjLmmSoYoOaoXfSRZ4aY8YSlVWR3QHlmpbQep_pf8DkEh9C7HBH0UzmhL-e0Tm-PY_nq_vSskaGps5Wz4c0BY May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:06:00.702223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3b0036437f8d4f2aaa19e707199916e3", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: dbee2da50ee6413db771071900703e29 May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:06:00.703773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Cannot 'detach_volume' instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf while it is in vm_state rescued May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'server_id': 'a5f8cbc1-6215-4f6e-922d-1080c7e893cf', 'id': 'e424c842-b647-4935-9ce1-5d9bb9deec4d'} May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:00.704607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf while it is in vm_state rescued May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf while it is in vm_state rescued May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:00.706508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Returning 409 to user: Cannot 'detach_volume' instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf while it is in vm_state rescued {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:00.707815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6d98f63d-1e8a-470d-bb3c-ab6c3722c05b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments/e424c842-b647-4935-9ce1-5d9bb9deec4d" status: 409 len: 152 microversion: 2.1 time: 0.098078 May 26 18:06:00.707815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 328/638] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:06:00 2022] DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments/e424c842-b647-4935-9ce1-5d9bb9deec4d => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 18:06:00.712825 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:00.713361 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.719704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.720155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.720915 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.721420 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.968291 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8dfdc767-f034-4deb-9377-e82f165f1d96 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/action" status: 202 len: 0 microversion: 2.1 time: 0.259006 May 26 18:06:00.968785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 311/639] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:06:00 2022] POST /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:00.977736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:00.981961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:00.984472 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.984928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:00.985690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:00.986126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:01.117305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:01.126531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cd2baaff-c271-43de-bd1e-4e58f64d7099 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1726 microversion: 2.1 time: 0.152576 May 26 18:06:01.127562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 329/640] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:00 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:02.145450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:02.147956 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:02.152745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.153203 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.154085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:02.154494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:02.288856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:02.297457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-63ba886e-820b-4341-86f9-8a35cef65e00 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1726 microversion: 2.1 time: 0.156677 May 26 18:06:02.298128 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 312/641] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:02 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:03.316367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:03.316983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:03.323696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.324144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.324917 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:03.325360 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:03.454205 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:03.463140 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-32eabf69-d9fc-4eb6-acdf-6f4f6e9af9ee tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1726 microversion: 2.1 time: 0.151322 May 26 18:06:03.463705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 330/642] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:03 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:04.479730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:04.480344 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:04.486811 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:04.487369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:04.488133 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:04.488564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:04.617822 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:04.625913 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cf26e5e1-c4f8-42ed-985f-9d2a68d01a83 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1732 microversion: 2.1 time: 0.150258 May 26 18:06:04.626402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 313/643] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:04 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:04.642500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:04.643646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:04.650352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:04.650807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:04.651612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:04.652067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:04.732721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d39a029-9a99-4bfe-b327-36803eca316a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094178 May 26 18:06:04.733309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 331/644] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:06:04 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:05.920978 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-c7990f50-6791-42b1-b91d-4b454e126dc6 req-701e00b1-ad2a-4683-a3af-fdf6ba8c5bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:05.931034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-c7990f50-6791-42b1-b91d-4b454e126dc6 req-701e00b1-ad2a-4683-a3af-fdf6ba8c5bb2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:05.931665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-c7990f50-6791-42b1-b91d-4b454e126dc6 req-701e00b1-ad2a-4683-a3af-fdf6ba8c5bb2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:05.945128 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-c7990f50-6791-42b1-b91d-4b454e126dc6 req-701e00b1-ad2a-4683-a3af-fdf6ba8c5bb2 service nova] Creating event network-changed:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:06:05.948933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-c7990f50-6791-42b1-b91d-4b454e126dc6 req-701e00b1-ad2a-4683-a3af-fdf6ba8c5bb2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032107 May 26 18:06:05.949560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 314/645] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:07.964110 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-09e62a47-2bc2-49a4-a129-f31842ec650e req-1bc8de45-e8fd-45d0-8d36-7f6d16d83c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:07.967639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=32 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:07.972983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-09e62a47-2bc2-49a4-a129-f31842ec650e req-1bc8de45-e8fd-45d0-8d36-7f6d16d83c11 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:07.973422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-09e62a47-2bc2-49a4-a129-f31842ec650e req-1bc8de45-e8fd-45d0-8d36-7f6d16d83c11 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:07.984261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-09e62a47-2bc2-49a4-a129-f31842ec650e req-1bc8de45-e8fd-45d0-8d36-7f6d16d83c11 service nova] Creating event network-changed:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:06:07.989238 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-09e62a47-2bc2-49a4-a129-f31842ec650e req-1bc8de45-e8fd-45d0-8d36-7f6d16d83c11 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029294 May 26 18:06:07.989809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 332/646] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:23.067613 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=27 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:23.068371 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:23.234884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:23.235477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:23.242135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.251033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.251033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.251033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.267633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d741dad2-77cf-483b-b7c3-1e8de303d00a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/ips" status: 200 len: 148 microversion: 2.1 time: 0.201707 May 26 18:06:23.268187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 315/647] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:06:23 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/ips => generated 148 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:23.276666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=53 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:23.281269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d426a760-2e6d-41c9-8fa2-5b662636a614"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:23.282405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:23.288634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.289087 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.298396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.298396 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.373758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: POST /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/os-volume_attachments HTTP/1.1 May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 74 May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:06:23.375512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {"volumeAttachment": {"volumeId": "d426a760-2e6d-41c9-8fa2-5b662636a614"}} May 26 18:06:23.377040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'server_id': '7ee5f274-1ed9-4543-a4c3-fbc71cfe3453', 'body': {'volumeAttachment': {'volumeId': 'd426a760-2e6d-41c9-8fa2-5b662636a614'}}} May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:23.377906 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:23.379449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 400 to user: Invalid volume: volume d426a760-2e6d-41c9-8fa2-5b662636a614 is already attached to instances: a948f2ab-1a7a-4cee-b600-643f1902a6ab {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f84775b1-076a-4900-b5d0-a71174247026 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101799 May 26 18:06:23.381425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 333/648] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:06:23 2022] POST /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:06:23.386065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:23.390123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:23.392732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.393181 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.393952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.394388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.419543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:23.775967 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bb42bab7-e60f-4e5e-ae89-306d07d9d73e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 204 len: 0 microversion: 2.1 time: 0.393488 May 26 18:06:23.776560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 316/649] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:06:23 2022] DELETE /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:06:23.785069 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:23.785679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:23.792749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.793193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.793946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:23.794378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:23.928847 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:23.936455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-152f0a14-8890-4859-b9ab-bda57c60fca6 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1684 microversion: 2.1 time: 0.155325 May 26 18:06:23.937012 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 334/650] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:23 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:24.954057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:24.954747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:24.961735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.962521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:24.963052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:24.963485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:25.094234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:25.102013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-60762e13-2d79-4fc6-b115-0f4f9b08e43a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1684 microversion: 2.1 time: 0.152149 May 26 18:06:25.102578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 317/651] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:24 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:26.121293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:26.121920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:26.128608 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.129070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.129852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.130288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.265912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:26.274640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c8035fd0-e12e-46a3-85e2-369482894cd8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1684 microversion: 2.1 time: 0.157683 May 26 18:06:26.275238 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 335/652] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:26 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:26.649932 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-026728f3-3367-467e-9e20-76a58febbd2c req-4de5cb6b-bb93-40cf-b2ca-1b2b4ff4662c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee5f274-1ed9-4543-a4c3-fbc71cfe3453", "name": "network-vif-deleted", "tag": "211aeb7e-8b4f-4080-899f-53eebc799203"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:26.662731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-026728f3-3367-467e-9e20-76a58febbd2c req-4de5cb6b-bb93-40cf-b2ca-1b2b4ff4662c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:26.663146 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-026728f3-3367-467e-9e20-76a58febbd2c req-4de5cb6b-bb93-40cf-b2ca-1b2b4ff4662c service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:26.675509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-026728f3-3367-467e-9e20-76a58febbd2c req-4de5cb6b-bb93-40cf-b2ca-1b2b4ff4662c service nova] Creating event network-vif-deleted:211aeb7e-8b4f-4080-899f-53eebc799203 for instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 on hv-cinder-83607 May 26 18:06:26.682022 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-026728f3-3367-467e-9e20-76a58febbd2c req-4de5cb6b-bb93-40cf-b2ca-1b2b4ff4662c service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036004 May 26 18:06:26.682633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 318/653] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:27.292593 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:27.293130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:27.299883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.300335 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.301108 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.301549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.334292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:27.334757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:27.335368 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'fault' on Instance uuid 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:27.379539 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:27.387604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e825e685-a60e-45de-b064-a7e6894b618e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 200 len: 1336 microversion: 2.1 time: 0.099313 May 26 18:06:27.400769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 336/654] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:27 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 1336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:28.405792 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:28.406484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:28.414499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:28.415068 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:28.415858 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:28.416333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:28.430407 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 HTTP/1.1 May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:06:28.432041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:06:28.433572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '7ee5f274-1ed9-4543-a4c3-fbc71cfe3453'} May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:28.434445 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:06:28.435901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:06:28.437358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:28.437358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1fac52a4-cd1d-4eeb-9680-9c6429e89a68 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 404 len: 111 microversion: 2.1 time: 0.031887 May 26 18:06:28.437534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 319/655] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:28 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:06:28.442543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-023848a2-dea9-4fc9-bf52-77139e89e1fc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '.version_select at 0x7f4b89715160>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:28.520233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-023848a2-dea9-4fc9-bf52-77139e89e1fc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866135573" status: 202 len: 0 microversion: 2.1 time: 0.081359 May 26 18:06:28.520936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 337/656] 10.222.0.121 () {58 vars in 1225 bytes} [Thu May 26 18:06:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866135573 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:29.592733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:29.593205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:29.599607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.600059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.600829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:29.601273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:29.690503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'services' on Instance uuid a948f2ab-1a7a-4cee-b600-643f1902a6ab {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:30.010124 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f4896a9f-2199-4458-bb6d-13637eea63eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments/d426a760-2e6d-41c9-8fa2-5b662636a614" status: 202 len: 0 microversion: 2.1 time: 0.421082 May 26 18:06:30.010921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 320/657] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:06:29 2022] DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments/d426a760-2e6d-41c9-8fa2-5b662636a614 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:30.032324 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:30.033276 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:30.040122 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.040576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.041393 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:30.041830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:30.072174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cecab4e6-e42e-4bc2-a9b1-e6c2c6ed5b67 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 May 26 18:06:30.072654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 338/658] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:06:30 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:31.085294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:31.087161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:31.094112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.094575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.095388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:31.095831 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:31.125346 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4384b19e-177a-481e-8e9f-2c40e4dc6dfa tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 May 26 18:06:31.125895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 321/659] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:06:31 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:32.136409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:32.137423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:32.144005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.144458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.145209 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.145647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.176734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-70b8f6b8-44d3-4116-958b-41c533d91901 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044166 May 26 18:06:32.181859 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 339/660] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:06:32 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:06:32.236259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:32.243940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:32.243940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.243940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.244490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.244929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.270118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:32.651235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b6946d82-3819-4d2f-8d5c-ab5ebf5259d2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 204 len: 0 microversion: 2.1 time: 0.418550 May 26 18:06:32.651817 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 322/661] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:06:32 2022] DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:06:32.660004 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:32.660610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:32.666621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.667107 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.667862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:32.668299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:32.797299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:32.804753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4b506fd0-e74d-4b55-b0ca-042c56242a44 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1684 microversion: 2.1 time: 0.148580 May 26 18:06:32.805848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 340/662] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:32 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:33.823105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:33.823701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:33.830625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.831162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.831892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:33.832361 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:33.970651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:33.979177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6efe9846-94da-4878-9779-a611b74ff58f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1684 microversion: 2.1 time: 0.160789 May 26 18:06:33.979690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 323/663] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:33 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:34.662404 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-2a0e1880-a36f-44dd-8036-41ddce5a915a req-ca08fc1e-cc34-4fb6-b81d-69fd521f1cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a948f2ab-1a7a-4cee-b600-643f1902a6ab", "name": "network-vif-deleted", "tag": "2cb12eeb-27c0-467e-84f0-7f1df273a4a2"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:34.671786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-2a0e1880-a36f-44dd-8036-41ddce5a915a req-ca08fc1e-cc34-4fb6-b81d-69fd521f1cf2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:34.674731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-2a0e1880-a36f-44dd-8036-41ddce5a915a req-ca08fc1e-cc34-4fb6-b81d-69fd521f1cf2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:34.684317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-2a0e1880-a36f-44dd-8036-41ddce5a915a req-ca08fc1e-cc34-4fb6-b81d-69fd521f1cf2 service nova] Creating event network-vif-deleted:2cb12eeb-27c0-467e-84f0-7f1df273a4a2 for instance a948f2ab-1a7a-4cee-b600-643f1902a6ab on hv-cinder-83607 May 26 18:06:34.689425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-2a0e1880-a36f-44dd-8036-41ddce5a915a req-ca08fc1e-cc34-4fb6-b81d-69fd521f1cf2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030720 May 26 18:06:34.690031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 341/664] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:35.005766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:35.006326 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:35.012918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.013396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.014148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.014578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.047288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:35.047737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:35.048241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'fault' on Instance uuid a948f2ab-1a7a-4cee-b600-643f1902a6ab {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:35.091762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:35.100155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4524642c-a97e-4795-9cb6-ffce3ba3d7eb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 200 len: 1335 microversion: 2.1 time: 0.098470 May 26 18:06:35.100732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 324/665] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:35 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 1335 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:36.119471 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:36.120199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:36.127171 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.127625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.128399 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:36.128839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:36.144501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab HTTP/1.1 May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:06:36.146216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:06:36.147804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'a948f2ab-1a7a-4cee-b600-643f1902a6ab'} May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:36.148851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:06:36.150327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:36.151465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:36.151465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-289308e5-d5e7-448b-9d2a-b975c17b4ddb tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 404 len: 111 microversion: 2.1 time: 0.033280 May 26 18:06:36.151465 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 342/666] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:36 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:06:36.157620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9b0ceab9-5be4-4d6b-876d-256a315fa1dc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '.version_select at 0x7f4b8975f040>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:36.249642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9b0ceab9-5be4-4d6b-876d-256a315fa1dc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647405369" status: 202 len: 0 microversion: 2.1 time: 0.095997 May 26 18:06:36.250236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 325/667] 10.222.0.121 () {58 vars in 1225 bytes} [Thu May 26 18:06:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647405369 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:06:37.008993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0e98d759-ba8e-4a9e-b19e-2fe9636f31b8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: .version_select at 0x7f4b8975b8b0>, body: {"keypair": {"name": "tempest-keypair-1230929500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdj2qHlAKzHpyPnJgDStXD+K9O7YLQx7eevB51eoD0j9PK+xZrrfll9xlt8lavI0wuZ3oS1POJWD6PFoP9hjKMrJ6BNjNK8KENdnP9QMlOf9gotY7mQ2W282MbxdFK5WA=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:37.022620 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-0e98d759-ba8e-4a9e-b19e-2fe9636f31b8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:37.027055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-0e98d759-ba8e-4a9e-b19e-2fe9636f31b8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:37.141545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0e98d759-ba8e-4a9e-b19e-2fe9636f31b8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136953 May 26 18:06:37.142183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 343/668] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:06:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:39.362717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1558453244", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd0758f-2a58-48c2-a018-de67fccda659"}], "security_groups": [{"name": "tempest-securitygroup--1455980853"}], "key_name": "tempest-keypair-1230929500", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:39.464108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] validate_networks() for [('ccd0758f-2a58-48c2-a018-de67fccda659', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:39.827336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:39.827756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:39.828234 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:39.828671 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:39.829083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:39.838688 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.839170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.839991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:39.840427 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:39.857507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:39.861629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:39.873213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:39.875550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:39.967813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-92eb387b-1b60-4bd6-826b-82806a86cea0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.609258 May 26 18:06:39.968667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 326/669] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:06:39 2022] POST /compute/v2.1/servers => generated 404 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:06:39.979093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3bb28855-aede-45a6-a390-41d9e67a5f3e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:39.979818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3bb28855-aede-45a6-a390-41d9e67a5f3e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.038938 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3bb28855-aede-45a6-a390-41d9e67a5f3e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:40.046176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3bb28855-aede-45a6-a390-41d9e67a5f3e tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1246 microversion: 2.1 time: 0.071463 May 26 18:06:40.047021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 344/670] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:39 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:40.154385 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.155039 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.162020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.162596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.163324 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.163760 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.192761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2e571c05-ec23-47fa-8d27-bb395df7ed30 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments/37a50377-2d1d-4061-be4b-461804ad1038" status: 200 len: 194 microversion: 2.20 time: 0.042352 May 26 18:06:40.193340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 327/671] 10.222.0.121 () {60 vars in 1458 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments/37a50377-2d1d-4061-be4b-461804ad1038 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:06:40.257418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.258673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.264479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.264928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.265719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.266156 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.350623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lazy-loading 'services' on Instance uuid 33849f73-e433-4e48-947b-b1e14b3844ae {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:06:40.553453 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4e675d5d-cce3-4698-aa0e-cc6269ddb8b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments/37a50377-2d1d-4061-be4b-461804ad1038" status: 202 len: 0 microversion: 2.20 time: 0.299688 May 26 18:06:40.554058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 345/672] 10.222.0.121 () {60 vars in 1461 bytes} [Thu May 26 18:06:40 2022] DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments/37a50377-2d1d-4061-be4b-461804ad1038 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:06:40.563271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:40.564250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:40.570813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.571369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.572136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:40.572564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:40.601085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6c15b8ec-3938-4ea2-a34a-09dedf53281b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041704 May 26 18:06:40.602128 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 328/673] 10.222.0.121 () {60 vars in 1347 bytes} [Thu May 26 18:06:40 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:06:41.063990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.064694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.071037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.071538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.077767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.077767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.138224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:41.157155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ba7328ee-c93f-4c09-b0d4-d712773ce236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1250 microversion: 2.1 time: 0.097716 May 26 18:06:41.159315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 346/674] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:41 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1250 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:41.614194 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.615091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.623466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.623920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.624823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.625265 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.665975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9a0453bc-e675-4ed2-af82-88c648a2cf6f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055988 May 26 18:06:41.666583 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 329/675] 10.222.0.121 () {60 vars in 1347 bytes} [Thu May 26 18:06:41 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:41.731079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:41.731579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:41.737808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.738270 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.739082 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:41.739515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:41.765510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:06:42.011343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-46c7108b-a54c-4c94-af1f-7d361e39f7da tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 204 len: 0 microversion: 2.20 time: 0.284453 May 26 18:06:42.011929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 347/676] 10.222.0.121 () {60 vars in 1284 bytes} [Thu May 26 18:06:41 2022] DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:06:42.020227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:42.020859 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:42.027008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.027505 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.028277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.028715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.048393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:42.163309 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.169880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.171690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.172911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7ef377b7-7ef3-4cdd-8891-4ffaf009478a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.156617 May 26 18:06:42.173740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 330/677] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:42 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:42.176530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:42.177224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:42.184641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.185075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.191685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:42.191685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:42.247968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:42.255531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2a7b3c6b-a151-45a2-9b37-47ebd6613898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1306 microversion: 2.1 time: 0.083516 May 26 18:06:42.260822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 348/678] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:42 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:43.192606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:43.193248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:43.200913 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.201374 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.202155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.202607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.274045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:43.275947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:43.282956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.283405 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.284205 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:43.284641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:43.364144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:43.369128 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:43.375310 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-38c89c97-9726-4ba8-90aa-7d54bcbe92ca tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1306 microversion: 2.1 time: 0.105365 May 26 18:06:43.376054 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 349/679] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:43 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:43.378222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:43.379761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:43.380918 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a52ecb1b-50c0-413d-8c05-4eb5f16d9954 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.192263 May 26 18:06:43.381462 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 331/680] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:43 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:44.393912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:44.393912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:44.400439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:44.401296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.401754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.402365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:44.402602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.403074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.411275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.416642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.420492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:44.421107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:44.621734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.635111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.640010 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9917dd1b-fced-45ae-869b-fdde5531aefe tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.247003 May 26 18:06:44.643191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 350/681] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:44 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:44.645395 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.647254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:44.648576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0fba40a7-36d1-4842-b744-fd6abc73ad5a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1730 microversion: 2.20 time: 0.253373 May 26 18:06:44.649416 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 332/682] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:44 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:06:45.426537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-4bafa19f-6b8a-4149-930e-7afc72d9e384 req-3413ad4a-a73b-49bf-87ea-7b670e3b8dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33849f73-e433-4e48-947b-b1e14b3844ae", "name": "network-vif-deleted", "tag": "eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:45.444931 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-4bafa19f-6b8a-4149-930e-7afc72d9e384 req-3413ad4a-a73b-49bf-87ea-7b670e3b8dee service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.445621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-4bafa19f-6b8a-4149-930e-7afc72d9e384 req-3413ad4a-a73b-49bf-87ea-7b670e3b8dee service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.451031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:45.459121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-4bafa19f-6b8a-4149-930e-7afc72d9e384 req-3413ad4a-a73b-49bf-87ea-7b670e3b8dee service nova] Creating event network-vif-deleted:eaae21a6-d1a7-4aa8-ab24-e188fa87fcb1 for instance 33849f73-e433-4e48-947b-b1e14b3844ae on hv-cinder-83607 May 26 18:06:45.465013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-4bafa19f-6b8a-4149-930e-7afc72d9e384 req-3413ad4a-a73b-49bf-87ea-7b670e3b8dee service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042235 May 26 18:06:45.470239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 351/683] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:45.654474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:45.655141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:45.661716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.662408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.663381 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.664002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.672879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:45.673367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:45.688218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.689157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.690773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:45.691481 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:45.820245 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.831111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.833243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.834670 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a20f61b4-8c8c-4ab6-a8d7-6ea7e528cf4f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 200 len: 1371 microversion: 2.20 time: 0.170841 May 26 18:06:45.835858 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 352/684] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:45 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:06:45.891660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:45.899742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7dd642d5-7629-4a6e-97ac-0003f4cae0c4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.249907 May 26 18:06:45.900425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 333/685] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:45 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:46.854100 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:46.854619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:46.861940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.868787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.868787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.868787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.877438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae HTTP/1.1 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:06:46.879128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:06:46.880796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '33849f73-e433-4e48-947b-b1e14b3844ae'} May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:06:46.881625 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:06:46.883144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:06:46.884556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:06:46.884556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9c8c1fc0-19cb-46db-ae4d-c8b216ce9093 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 404 len: 111 microversion: 2.20 time: 0.031526 May 26 18:06:46.884556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 353/686] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:46 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:06:46.889897 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d9f5441a-f2bf-4838-a301-28d9424acb18 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '.version_select at 0x7f4b897e2820>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:46.918098 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:46.918707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:46.925075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.925519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.926317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:46.926758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:46.965050 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d9f5441a-f2bf-4838-a301-28d9424acb18 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203171491" status: 204 len: 0 microversion: 2.20 time: 0.078861 May 26 18:06:46.965664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 334/687] 10.222.0.121 () {60 vars in 1266 bytes} [Thu May 26 18:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1203171491 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:06:47.115317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:47.122846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cb33cae4-1428-4ca4-aebc-04e8c6bc2509 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.209739 May 26 18:06:47.123595 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 354/688] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:46 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:47.484251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-d532e83f-4a16-4589-a08a-9ffcbee0768d req-6a63d756-2e8b-4700-8bf9-b3ca4516a9e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f22e1c7-5984-4649-aca5-fdc25977a831", "tag": "f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:47.492669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d532e83f-4a16-4589-a08a-9ffcbee0768d req-6a63d756-2e8b-4700-8bf9-b3ca4516a9e4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:47.493351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d532e83f-4a16-4589-a08a-9ffcbee0768d req-6a63d756-2e8b-4700-8bf9-b3ca4516a9e4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:47.503943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-d532e83f-4a16-4589-a08a-9ffcbee0768d req-6a63d756-2e8b-4700-8bf9-b3ca4516a9e4 service nova] Creating event network-changed:f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02 for instance 6f22e1c7-5984-4649-aca5-fdc25977a831 on hv-cinder-83607 May 26 18:06:47.510362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-d532e83f-4a16-4589-a08a-9ffcbee0768d req-6a63d756-2e8b-4700-8bf9-b3ca4516a9e4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029800 May 26 18:06:47.510989 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 335/689] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:47.832400 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d0b1e26f-9949-47b8-8185-79b2b76fac2d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: .version_select at 0x7f4b898b3670>, body: {"keypair": {"name": "tempest-keypair-296772945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUuhqY7buB1XzvMEp/U1fKNh5cQVLoXKUQPPFdTVGU1MQPqBXg9FL7ERj2u70bZP+0oPQ48JL6PcwE/6xPWZhD9JDdWGrzuAE5GM3at9BPpqChVCpqUFWWIGb4nukQeVQ=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:47.846037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-d0b1e26f-9949-47b8-8185-79b2b76fac2d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:47.849782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-d0b1e26f-9949-47b8-8185-79b2b76fac2d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for user fe1c86c411834f1c8d2775a5b2c5f1d1 and project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:47.908698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d0b1e26f-9949-47b8-8185-79b2b76fac2d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.080134 May 26 18:06:47.909354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 355/690] 10.222.0.121 () {62 vars in 1204 bytes} [Thu May 26 18:06:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 18:06:48.141164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:48.142005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:48.148524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.149120 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.149997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:48.151041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:48.286755 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:48.294829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-42868144-4933-43a8-9010-fe2856ea6568 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.158371 May 26 18:06:48.295423 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 336/691] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:48 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:49.313015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:49.313558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:49.320051 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.320499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.321262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:49.321698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:49.496196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:49.505677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-71930bb4-4861-415d-90a5-7d92294527a1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.197011 May 26 18:06:49.515651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 356/692] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:49 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:50.223213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-683486768", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1050f433-8bfb-4b2f-a703-d9cd6244e4ba"}], "security_groups": [{"name": "tempest-securitygroup--706244458"}], "key_name": "tempest-keypair-296772945", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:50.230499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:50.231241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=6 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:50.325366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] validate_networks() for [('1050f433-8bfb-4b2f-a703-d9cd6244e4ba', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:06:50.522423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:50.523124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:50.529973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.534663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.534663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.534663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.733820 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:50.741147 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-250bb732-4460-4ed9-b1fb-13cc4e0a15c3 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.222543 May 26 18:06:50.741718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 357/693] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:50 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:50.765659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:06:50.766081 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:06:50.766553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:06:50.767021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:06:50.767465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:06:50.777020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.781565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.781565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:50.781565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:50.795616 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:06:50.799738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Getting quotas for user fe1c86c411834f1c8d2775a5b2c5f1d1 and project 68bd0110e4fd4e6dbef9f65397908292. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:06:50.810637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:06:50.812895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:06:50.966533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d4ada4d4-3ead-4de7-a0f1-2528dd6800b1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.747895 May 26 18:06:50.967229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 337/694] 10.222.0.121 () {62 vars in 1192 bytes} [Thu May 26 18:06:50 2022] POST /compute/v2.1/servers => generated 403 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 26 18:06:50.977130 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:50.977731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:51.042008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.050323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.052037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.053458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0000062d-ebc2-4a03-bcec-d505a2d79601 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1284 microversion: 2.20 time: 0.080040 May 26 18:06:51.054391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 358/695] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:50 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:51.758151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:51.758777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:51.766461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:51.766948 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:51.767731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:51.768200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:51.902641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:51.910431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0e25ce8e-8940-4a7a-837c-95a184ae0898 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.156394 May 26 18:06:51.911177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 338/696] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:51 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:52.073191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:52.073757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:52.080115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.080564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.081333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.081772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.154131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:52.164073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:52.165782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:52.168013 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b8fd2bae-bb01-43f7-9268-a5d8e600e509 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1288 microversion: 2.20 time: 0.099967 May 26 18:06:52.168780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 359/697] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:52 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:52.929154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:52.930523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:52.934356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:52.938483 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.939035 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:52.939872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:52.940427 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.085755 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:53.094071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9419f934-f42d-4a17-9b94-4dc1097e91a2 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.169129 May 26 18:06:53.094853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 339/698] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:52 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:53.186524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:53.187123 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:53.195040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.195658 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.196622 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.197113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.227166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-43c3e1f2-a37b-4e90-9362-3b0bdc326a87 req-cfb98b37-b778-4733-adfa-dbd0baa7a050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f22e1c7-5984-4649-aca5-fdc25977a831", "name": "network-vif-plugged", "status": "completed", "tag": "f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:53.237809 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-43c3e1f2-a37b-4e90-9362-3b0bdc326a87 req-cfb98b37-b778-4733-adfa-dbd0baa7a050 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:53.238327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-43c3e1f2-a37b-4e90-9362-3b0bdc326a87 req-cfb98b37-b778-4733-adfa-dbd0baa7a050 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:53.255974 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-43c3e1f2-a37b-4e90-9362-3b0bdc326a87 req-cfb98b37-b778-4733-adfa-dbd0baa7a050 service nova] Creating event network-vif-plugged:f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02 for instance 6f22e1c7-5984-4649-aca5-fdc25977a831 on hv-cinder-83607 May 26 18:06:53.262079 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-43c3e1f2-a37b-4e90-9362-3b0bdc326a87 req-cfb98b37-b778-4733-adfa-dbd0baa7a050 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038636 May 26 18:06:53.263400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 340/699] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:53.268602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:53.277299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:53.279118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:53.280227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1fa785bc-9b2b-456c-a2fc-aef6a32b2672 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1342 microversion: 2.20 time: 0.098239 May 26 18:06:53.280778 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 360/700] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:53 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:54.112696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:54.113564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:54.120556 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.121016 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.121789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.122229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.253310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.262740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d1a6c8cf-cae2-49d5-9bfb-4c4ceb262957 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1372 microversion: 2.1 time: 0.155150 May 26 18:06:54.263347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 341/701] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:54 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:06:54.298039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:54.298640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:54.300634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.305400 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.310431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.310431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.310431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.443484 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.452386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.457828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:54.457828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f2fb9594-bc00-4b10-9fa0-5ccf1774198d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.161287 May 26 18:06:54.457828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 361/702] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:54 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:54.888176 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-86d881de-ca0c-4a8c-9770-6ae22552fd9a req-e17ee32a-7bab-4bb3-83ae-e4b9854563ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:54.907851 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-86d881de-ca0c-4a8c-9770-6ae22552fd9a req-e17ee32a-7bab-4bb3-83ae-e4b9854563ff service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:54.909693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-86d881de-ca0c-4a8c-9770-6ae22552fd9a req-e17ee32a-7bab-4bb3-83ae-e4b9854563ff service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:54.921360 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-86d881de-ca0c-4a8c-9770-6ae22552fd9a req-e17ee32a-7bab-4bb3-83ae-e4b9854563ff service nova] Creating event network-changed:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:06:54.926496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-86d881de-ca0c-4a8c-9770-6ae22552fd9a req-e17ee32a-7bab-4bb3-83ae-e4b9854563ff service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042245 May 26 18:06:54.927123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 342/703] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:06:55.280614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.281136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:55.287636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.288095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.288843 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.289275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.422644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.430269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2b5372ea-d45e-405a-bcdb-122e86f261d8 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1562 microversion: 2.1 time: 0.154145 May 26 18:06:55.430886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 362/704] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:06:55 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:06:55.447550 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.448186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:55.454981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.455430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.456194 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.456630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.483604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:55.485449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:55.493409 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.494153 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.495202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:55.495801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:55.552883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-78b77756-0f72-408e-85df-23ae87a14ff7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109490 May 26 18:06:55.554233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 343/705] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:06:55 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:55.650684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.660066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.661554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:55.662652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-75765c8b-e76e-4820-bff0-39e88c495b86 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.188370 May 26 18:06:55.663259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 363/706] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:55 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:56.680643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:56.681251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:56.687727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.688181 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:56.688955 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:56.689391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:56.823597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:56.831591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:56.833080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:56.834181 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f76695a8-a5e3-48c8-96de-27b80e3da0ff tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.157892 May 26 18:06:56.834729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 344/707] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:56 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:57.044446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-978e1872-9c89-4419-a805-0924448977ae req-cc7de095-089c-4d67-ade6-c14abfb1fa9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f22e1c7-5984-4649-aca5-fdc25977a831", "tag": "f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:06:57.053520 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-978e1872-9c89-4419-a805-0924448977ae req-cc7de095-089c-4d67-ade6-c14abfb1fa9a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:57.054040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-978e1872-9c89-4419-a805-0924448977ae req-cc7de095-089c-4d67-ade6-c14abfb1fa9a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:57.065509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-978e1872-9c89-4419-a805-0924448977ae req-cc7de095-089c-4d67-ade6-c14abfb1fa9a service nova] Creating event network-changed:f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02 for instance 6f22e1c7-5984-4649-aca5-fdc25977a831 on hv-cinder-83607 May 26 18:06:57.070766 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-978e1872-9c89-4419-a805-0924448977ae req-cc7de095-089c-4d67-ade6-c14abfb1fa9a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030470 May 26 18:06:57.071525 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 364/708] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:06:57.854113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:57.855597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:57.862600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:57.863182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:57.864293 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:57.865037 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:58.005796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.014257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.015775 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:58.016886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-aa90ffa8-bd46-4edb-85d3-8dc13648ce1e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.167470 May 26 18:06:58.019749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 345/709] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:57 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:06:59.035326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:06:59.036031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:06:59.044430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.044882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.049696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:06:59.049696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:06:59.186908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:59.194880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:59.196376 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:06:59.197478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d80b5c4f-889b-44a7-9058-73c3fbe9f2ac tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.166542 May 26 18:06:59.198083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 365/710] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:06:59 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:00.215591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:00.221895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:00.222793 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.223279 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.224076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.224517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.352165 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:00.360894 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:00.362392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:00.363528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4aedbc6c-e741-4c0b-9352-90d285e73b79 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.152211 May 26 18:07:00.364079 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 346/711] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:00 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:00.860690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:00.861194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:00.867639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.868087 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.868868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:00.869308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:00.950089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'services' on Instance uuid a5f8cbc1-6215-4f6e-922d-1080c7e893cf {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:01.048850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=12 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.220893 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5b906a37-c614-43f0-96d0-ebf0bf9c4fb2 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments/e424c842-b647-4935-9ce1-5d9bb9deec4d" status: 202 len: 0 microversion: 2.1 time: 0.363862 May 26 18:07:01.221638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 366/712] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:07:00 2022] DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments/e424c842-b647-4935-9ce1-5d9bb9deec4d => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:01.230273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:01.231238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:01.233222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.233884 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=6 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.239121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.239571 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.240376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.240877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.273771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2a767984-633b-43ca-aa07-3c2106445568 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047756 May 26 18:07:01.274334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 347/713] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:07:01 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:01.382654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:01.383433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:01.390653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.391146 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.391947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:01.392394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:01.525538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:01.534075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:01.535619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:01.536775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e7a6bbba-34cd-451b-afb0-21d4dc44e1f5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.158449 May 26 18:07:01.537419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 367/714] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:01 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:02.286292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:02.287284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:02.295012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.295460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.296220 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.296653 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.325640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-31ee0339-484f-4f8e-8a95-1dddad30290a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043647 May 26 18:07:02.326194 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 348/715] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:07:02 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:02.555605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:02.556276 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:02.563506 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.569507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.569507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:02.569507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:02.695422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.703493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.705008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:02.712725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1bde36fa-9207-41b0-8dbf-a97c74221726 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.154389 May 26 18:07:02.712725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 368/716] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:02 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:03.223066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-f4d22ff3-11db-4ce8-9c25-c7d173f7b601 req-62a08e0e-0ee2-40dc-ad79-312f14c2c7bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "name": "network-vif-plugged", "status": "completed", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:03.230994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f4d22ff3-11db-4ce8-9c25-c7d173f7b601 req-62a08e0e-0ee2-40dc-ad79-312f14c2c7bf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.231438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f4d22ff3-11db-4ce8-9c25-c7d173f7b601 req-62a08e0e-0ee2-40dc-ad79-312f14c2c7bf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.243840 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-f4d22ff3-11db-4ce8-9c25-c7d173f7b601 req-62a08e0e-0ee2-40dc-ad79-312f14c2c7bf service nova] Creating event network-vif-plugged:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:07:03.249207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-f4d22ff3-11db-4ce8-9c25-c7d173f7b601 req-62a08e0e-0ee2-40dc-ad79-312f14c2c7bf service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029979 May 26 18:07:03.249555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 349/717] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:03.337358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.338361 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.345532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.345986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.346769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.347234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.379669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1c388a97-5bbd-4e5a-986d-a1b370242d90 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046166 May 26 18:07:03.380322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 369/718] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:07:03.468444 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.469004 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.475198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.479396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.479396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.479396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.503074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:03.538268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:03.725120 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.725814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.734258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.734738 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.735579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.736023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.844923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-15292848-74b8-4850-acf0-117047f67cbd tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 204 len: 0 microversion: 2.1 time: 0.380985 May 26 18:07:03.845503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 350/719] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:07:03 2022] DELETE /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:03.853632 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:03.854837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:03.860937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.861387 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.862156 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:03.862587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:03.869624 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.878468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.880221 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:03.881329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9fff56ec-db07-4f13-a368-db9bbc26e729 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.160124 May 26 18:07:03.881890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 370/720] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:07:03.993316 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:04.001524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e294ccdc-967f-48be-88bf-992cb3159e80 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1692 microversion: 2.1 time: 0.151901 May 26 18:07:04.002089 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 351/721] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:03 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:04.899999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:04.900607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:04.907388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.907841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.908605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:04.909037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:04.913181 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:05.018040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:05.018800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:05.025520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.025979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.026854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:05.027273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:05.045008 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.053044 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.054535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.055824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c715041b-ce3a-4201-86a6-f5e73ae24f24 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.160188 May 26 18:07:05.056415 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 371/722] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:04 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:05.156940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:05.164454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fa060f83-159f-4b3a-93de-6fbcf764b023 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1692 microversion: 2.1 time: 0.150332 May 26 18:07:05.165084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 352/723] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:05 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:06.074501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:06.075161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:06.082021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.082523 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.086664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.086664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.181582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:06.182912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:06.189254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.189712 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.190488 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:06.190960 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:06.217683 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.225553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.227050 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.228138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ae50cb2b-0d5c-465e-b354-477ad15d9015 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.158250 May 26 18:07:06.228692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 372/724] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:06 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:06.325468 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:06.332940 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-190f3dc7-43e5-4c69-a112-96b39ff1a887 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1692 microversion: 2.1 time: 0.155238 May 26 18:07:06.333500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 353/725] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:06 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:07.245721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.246326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.252886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.253345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.254113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.254560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.350767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:07.351412 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:07.358850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.359374 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.360095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:07.360534 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:07.388801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.396816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.398297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.399448 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-08382eca-6014-4250-93f1-a45ffb456402 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1409 microversion: 2.20 time: 0.157873 May 26 18:07:07.400006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 373/726] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:07 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:07.491242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:07.498636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0c99651d-206f-4e59-b06e-8a010376c8e3 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1692 microversion: 2.1 time: 0.151685 May 26 18:07:07.499224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 354/727] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:07 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:08.418166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.418871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.425821 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.426269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.427065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.427498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.515857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.516463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.523535 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.524288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.525295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.525943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.592192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:08.602190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:08.603932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:08.606034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a96e06c8-c9db-4500-99c8-ae165881990c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1602 microversion: 2.20 time: 0.192409 May 26 18:07:08.606701 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 374/728] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1602 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:07:08.612816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:08.622026 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bc73bff8-5ed1-45c4-9970-150ef8056d53 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1625 microversion: 2.1 time: 0.110050 May 26 18:07:08.622607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 355/729] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1625 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:07:08.627990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:08.628859 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:08.638286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.646501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.646501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.646501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.720543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-60070802-8d5f-43f0-90d3-db0482f7e702 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096626 May 26 18:07:08.721393 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 375/730] 10.222.0.121 () {60 vars in 1320 bytes} [Thu May 26 18:07:08 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:07:08.850978 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-98b0ee46-6ae8-43e5-9d86-f94889b0ddff req-e22f5460-0d41-463e-b67a-564fa8ec8fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f8cbc1-6215-4f6e-922d-1080c7e893cf", "name": "network-vif-deleted", "tag": "37848c29-d67b-43e0-94fe-7491bf79f246"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:08.860344 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-98b0ee46-6ae8-43e5-9d86-f94889b0ddff req-e22f5460-0d41-463e-b67a-564fa8ec8fc1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:08.860790 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-98b0ee46-6ae8-43e5-9d86-f94889b0ddff req-e22f5460-0d41-463e-b67a-564fa8ec8fc1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:08.872728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-98b0ee46-6ae8-43e5-9d86-f94889b0ddff req-e22f5460-0d41-463e-b67a-564fa8ec8fc1 service nova] Creating event network-vif-deleted:37848c29-d67b-43e0-94fe-7491bf79f246 for instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf on hv-cinder-83607 May 26 18:07:08.877770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-98b0ee46-6ae8-43e5-9d86-f94889b0ddff req-e22f5460-0d41-463e-b67a-564fa8ec8fc1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030478 May 26 18:07:08.878580 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 356/731] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:09.667753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:09.667753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:09.667753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.667753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.668569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.668569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.689253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:09.689799 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:09.690264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'fault' on Instance uuid a5f8cbc1-6215-4f6e-922d-1080c7e893cf {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:09.771239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:09.780105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d7ac3d9e-0252-48f4-8ba6-717492ff0d60 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 200 len: 1339 microversion: 2.1 time: 0.144489 May 26 18:07:09.780688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 376/732] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:09 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:10.209798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-2ca384e7-8ae9-45bf-aaed-f99b77e7933d req-da99d2b4-615b-42f5-991c-b20c080d9a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:10.219105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2ca384e7-8ae9-45bf-aaed-f99b77e7933d req-da99d2b4-615b-42f5-991c-b20c080d9a15 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.219545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2ca384e7-8ae9-45bf-aaed-f99b77e7933d req-da99d2b4-615b-42f5-991c-b20c080d9a15 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.232590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-2ca384e7-8ae9-45bf-aaed-f99b77e7933d req-da99d2b4-615b-42f5-991c-b20c080d9a15 service nova] Creating event network-changed:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:07:10.237701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-2ca384e7-8ae9-45bf-aaed-f99b77e7933d req-da99d2b4-615b-42f5-991c-b20c080d9a15 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094185 May 26 18:07:10.240276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 357/733] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:10.798081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:10.798697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: a5f8cbc1-6215-4f6e-922d-1080c7e893cf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:10.812061 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.812808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.814032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:10.814736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:10.832913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] HTTP exception thrown: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Request method failure captured: May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf HTTP/1.1 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8ATla5nyp_QRlNI0k-JA_Y0IggjggSnxXeVUTbGrptaHWmjHRxzuU404trg_8oO3HOT7VyFf3EyUgqOHBj4zYl4YnXjLmmSoYoOaoXfSRZ4aY8YSlVWR3QHlmpbQep_pf8DkEh9C7HBH0UzmhL-e0Tm-PY_nq_vSskaGps5Wz4c0BY May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:07:10.835214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3b0036437f8d4f2aaa19e707199916e3", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: dbee2da50ee6413db771071900703e29 May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. May 26 18:07:10.836939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'a5f8cbc1-6215-4f6e-922d-1080c7e893cf'} May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:10.837876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. May 26 18:07:10.840198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:10.841775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Returning 404 to user: Instance a5f8cbc1-6215-4f6e-922d-1080c7e893cf could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:10.841775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-914625d2-7882-4eed-b796-8aa5e5df723a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf" status: 404 len: 111 microversion: 2.1 time: 0.045170 May 26 18:07:10.844110 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 377/734] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:10 2022] GET /compute/v2.1/servers/a5f8cbc1-6215-4f6e-922d-1080c7e893cf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:07:10.849448 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6d109c3d-88d0-4ee9-918e-0edec80f0df6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '.version_select at 0x7f4b8975ff70>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:10.933933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6d109c3d-88d0-4ee9-918e-0edec80f0df6 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209141465" status: 202 len: 0 microversion: 2.1 time: 0.088593 May 26 18:07:10.934520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 358/735] 10.222.0.121 () {58 vars in 1222 bytes} [Thu May 26 18:07:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209141465 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:07:14.330218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.330706 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:14.337329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.337778 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.338541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.339021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.364407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:14.696381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0bae4db6-ef97-49d1-b0c2-b09d84a71aae tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 204 len: 0 microversion: 2.1 time: 0.369654 May 26 18:07:14.696970 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 378/736] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:07:14 2022] DELETE /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:14.705508 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:14.706245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:14.712520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.712977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.713736 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:14.714173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:14.871466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:14.871466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dde8ff3c-c5ca-4d99-9a65-44404a15fd50 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1510 microversion: 2.1 time: 0.160462 May 26 18:07:14.871466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 359/737] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:14 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:15.879655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:15.880268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:15.886848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.887421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:15.898056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:15.898056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.025206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:16.033350 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-009d8bc7-2a6f-4548-a1c5-86f28bc63bad tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1510 microversion: 2.1 time: 0.157938 May 26 18:07:16.044538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 379/738] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:15 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:16.109104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-8576cc17-21e4-41c9-b91f-2c29b4f89892 req-3a524b55-ee30-4a23-84eb-ced17f769061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5aa272-8509-4b29-80a1-8db933234ecc", "name": "network-vif-deleted", "tag": "41c660b7-e9d5-45bc-89db-4b3e93ffd8cd"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:16.117895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-8576cc17-21e4-41c9-b91f-2c29b4f89892 req-3a524b55-ee30-4a23-84eb-ced17f769061 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:16.118352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-8576cc17-21e4-41c9-b91f-2c29b4f89892 req-3a524b55-ee30-4a23-84eb-ced17f769061 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:16.131997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-8576cc17-21e4-41c9-b91f-2c29b4f89892 req-3a524b55-ee30-4a23-84eb-ced17f769061 service nova] Creating event network-vif-deleted:41c660b7-e9d5-45bc-89db-4b3e93ffd8cd for instance 1b5aa272-8509-4b29-80a1-8db933234ecc on hv-cinder-83607 May 26 18:07:16.136069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-8576cc17-21e4-41c9-b91f-2c29b4f89892 req-3a524b55-ee30-4a23-84eb-ced17f769061 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 May 26 18:07:16.136684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 360/739] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:17.050590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:17.051224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:17.057821 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.058266 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.059114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.059758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.092787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:17.093227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:17.093671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lazy-loading 'fault' on Instance uuid 1b5aa272-8509-4b29-80a1-8db933234ecc {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:07:17.133812 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:17.141391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-150090ad-4a7b-4508-a400-96748bc44f95 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 200 len: 1315 microversion: 2.1 time: 0.094818 May 26 18:07:17.147682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 380/740] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:17 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 1315 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:18.159509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.160205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 1b5aa272-8509-4b29-80a1-8db933234ecc] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.166344 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.166789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.167592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.168023 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.181847 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] HTTP exception thrown: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Request method failure captured: May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc HTTP/1.1 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8ATla5nyp_QRlNI0k-JA_Y0IggjggSnxXeVUTbGrptaHWmjHRxzuU404trg_8oO3HOT7VyFf3EyUgqOHBj4zYl4YnXjLmmSoYoOaoXfSRZ4aY8YSlVWR3QHlmpbQep_pf8DkEh9C7HBH0UzmhL-e0Tm-PY_nq_vSskaGps5Wz4c0BY May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:07:18.183565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3b0036437f8d4f2aaa19e707199916e3", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: dbee2da50ee6413db771071900703e29 May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. May 26 18:07:18.185971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '1b5aa272-8509-4b29-80a1-8db933234ecc'} May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:18.187152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. May 26 18:07:18.188643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:07:18.189947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Returning 404 to user: Instance 1b5aa272-8509-4b29-80a1-8db933234ecc could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:18.189947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-55dab893-1042-45f9-b928-a45c5ebb9daa tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc" status: 404 len: 111 microversion: 2.1 time: 0.030903 May 26 18:07:18.189947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 361/741] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/1b5aa272-8509-4b29-80a1-8db933234ecc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:07:18.194427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.194961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.201343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.201786 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.202541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.203003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.226545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:07:18.569066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c1ebd845-bc98-4ec0-89de-a6dfce0f6c3a tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "DELETE /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 204 len: 0 microversion: 2.1 time: 0.378307 May 26 18:07:18.569662 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 381/742] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:07:18 2022] DELETE /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:07:18.577985 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:18.578596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:18.584962 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.585408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.586181 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:18.586623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:18.717466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:18.725043 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-33f3a6a5-1997-43e8-9160-7c2c556083a1 tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.150908 May 26 18:07:18.725595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 362/743] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:18 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:19.742890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:19.743516 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:19.749897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.750364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.751407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.751606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.907652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbee2da50ee6413db771071900703e29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0036437f8d4f2aaa19e707199916e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:07:19.915795 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2c6467e4-c754-44fc-ab57-ad42c9ed1a5f tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 200 len: 1525 microversion: 2.1 time: 0.177114 May 26 18:07:19.916990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 382/744] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:19 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:07:19.917792 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-135d8724-5cfb-4d50-a247-5311dac8596d req-ffdc7b81-1165-4ad5-a818-da1724e4c67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b24c05-9d81-4199-8295-d51b05cb919f", "name": "network-vif-deleted", "tag": "2d454edc-2998-4b2b-a787-49fda244cb59"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:07:19.927152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-135d8724-5cfb-4d50-a247-5311dac8596d req-ffdc7b81-1165-4ad5-a818-da1724e4c67f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:19.930561 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-135d8724-5cfb-4d50-a247-5311dac8596d req-ffdc7b81-1165-4ad5-a818-da1724e4c67f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:19.939077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-135d8724-5cfb-4d50-a247-5311dac8596d req-ffdc7b81-1165-4ad5-a818-da1724e4c67f service nova] Creating event network-vif-deleted:2d454edc-2998-4b2b-a787-49fda244cb59 for instance 25b24c05-9d81-4199-8295-d51b05cb919f on hv-cinder-83607 May 26 18:07:19.943914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-135d8724-5cfb-4d50-a247-5311dac8596d req-ffdc7b81-1165-4ad5-a818-da1724e4c67f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 May 26 18:07:19.944675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 363/745] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:07:20.935110 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:07:20.935724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] [instance: 25b24c05-9d81-4199-8295-d51b05cb919f] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:07:20.942158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.942613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.943576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:07:20.944019 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:07:20.957733 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] HTTP exception thrown: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Request method failure captured: May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f HTTP/1.1 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8ATla5nyp_QRlNI0k-JA_Y0IggjggSnxXeVUTbGrptaHWmjHRxzuU404trg_8oO3HOT7VyFf3EyUgqOHBj4zYl4YnXjLmmSoYoOaoXfSRZ4aY8YSlVWR3QHlmpbQep_pf8DkEh9C7HBH0UzmhL-e0Tm-PY_nq_vSskaGps5Wz4c0BY May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:07:20.959322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/3b0036437f8d4f2aaa19e707199916e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_3b0036437f8d4f2aaa19e707199916e3", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 3b0036437f8d4f2aaa19e707199916e3 May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-131499161 May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: dbee2da50ee6413db771071900703e29 May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-131499161-project May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. May 26 18:07:20.960875 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '25b24c05-9d81-4199-8295-d51b05cb919f'} May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:07:20.961801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. May 26 18:07:20.963312 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:07:20.964772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] Returning 404 to user: Instance 25b24c05-9d81-4199-8295-d51b05cb919f could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:07:20.964772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c10f1343-b070-487f-bf07-d511b951eb5b tempest-ServerRescueNegativeTestJSON-131499161 tempest-ServerRescueNegativeTestJSON-131499161-project] 10.222.0.121 "GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f" status: 404 len: 111 microversion: 2.1 time: 0.029806 May 26 18:07:20.964772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 383/746] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:07:20 2022] GET /compute/v2.1/servers/25b24c05-9d81-4199-8295-d51b05cb919f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:08:12.288929 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:12.289573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:12.291607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.292746 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.300078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.306417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.306417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:12.306417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:12.326930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6f8fb559-9806-46b2-974a-b858c9a2871f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/ips" status: 200 len: 150 microversion: 2.1 time: 0.042424 May 26 18:08:12.327735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 364/747] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:08:12 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:15.115688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2db24a36-432c-4f52-aefe-dc890cf57a62"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:15.116849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:15.119074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.120614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.126200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.126656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.127457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:15.127901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:15.923723 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-72c49060-df95-4b39-8160-ec7921f4690b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811753 May 26 18:08:15.924666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 384/748] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:08:15 2022] POST /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:23.441070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2db24a36-432c-4f52-aefe-dc890cf57a62"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:23.442264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.450154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.450684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.451492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.451933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.537727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: POST /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments HTTP/1.1 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 74 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:08:23.539675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {"volumeAttachment": {"volumeId": "2db24a36-432c-4f52-aefe-dc890cf57a62"}} May 26 18:08:23.541302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'server_id': '6f22e1c7-5984-4649-aca5-fdc25977a831', 'body': {'volumeAttachment': {'volumeId': '2db24a36-432c-4f52-aefe-dc890cf57a62'}}} May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:23.542924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:23.545046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 400 to user: Invalid volume: volume 2db24a36-432c-4f52-aefe-dc890cf57a62 is already attached to instances: 6f22e1c7-5984-4649-aca5-fdc25977a831 {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-06c7cdc3-206c-4125-a745-658d68282831 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105702 May 26 18:08:23.546889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 365/749] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:08:23 2022] POST /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 18:08:23.607045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.607623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.615482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.615932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.616705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.617141 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.700843 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'services' on Instance uuid 6f22e1c7-5984-4649-aca5-fdc25977a831 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:23.928939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dc5bcd47-9827-4d37-a763-341d551dcc32 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments/2db24a36-432c-4f52-aefe-dc890cf57a62" status: 202 len: 0 microversion: 2.1 time: 0.326262 May 26 18:08:23.929926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 385/750] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:08:23 2022] DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments/2db24a36-432c-4f52-aefe-dc890cf57a62 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:23.938182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:23.939170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:23.947799 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.948249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.949638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:23.950074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:23.979744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ba05d3af-7010-4a37-925f-973b56b4ee79 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 May 26 18:08:23.983332 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 366/751] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:08:23 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:24.992243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:24.993407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:25.000729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.001194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.001941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.002508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.032979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c7d3267a-961e-42f8-8388-267820f5107a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045283 May 26 18:08:25.034062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 386/752] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:08:24 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:08:25.096189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:25.096693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:25.103113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.106174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.106174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.106174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.131829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:08:25.428247 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d3a1f460-bfdd-4914-a675-572ea207b43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 204 len: 0 microversion: 2.1 time: 0.335911 May 26 18:08:25.428829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 367/753] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:08:25 2022] DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:08:25.437358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:25.438052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:25.444366 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.446236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.446236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:25.446236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:25.581263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:25.588738 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cf624f61-50b0-4bb5-bcb9-cb9cfd65ef21 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1687 microversion: 2.1 time: 0.155385 May 26 18:08:25.590014 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 387/754] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:25 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:26.608451 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:26.609277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:26.615919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.616368 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.622498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:26.622498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:26.755495 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:26.763248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6a6c2278-e824-4a1b-b699-2fc150bab6f5 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1687 microversion: 2.1 time: 0.160007 May 26 18:08:26.763811 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 368/755] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:26 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:27.780669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:27.781288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:27.787978 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.788438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.789219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:27.789656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:27.921459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:27.929285 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3d295bde-a75b-4ea4-8f59-ce5e51aecea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1687 microversion: 2.1 time: 0.152486 May 26 18:08:27.929853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 388/756] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:27 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:28.625405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-a0a08831-db18-4ae4-8203-29c6d9a6d40c req-f44c6344-e2fd-4eb9-a28b-38f01c3dbad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f22e1c7-5984-4649-aca5-fdc25977a831", "name": "network-vif-deleted", "tag": "f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:28.634336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-a0a08831-db18-4ae4-8203-29c6d9a6d40c req-f44c6344-e2fd-4eb9-a28b-38f01c3dbad1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:28.634953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-a0a08831-db18-4ae4-8203-29c6d9a6d40c req-f44c6344-e2fd-4eb9-a28b-38f01c3dbad1 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:28.647536 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-a0a08831-db18-4ae4-8203-29c6d9a6d40c req-f44c6344-e2fd-4eb9-a28b-38f01c3dbad1 service nova] Creating event network-vif-deleted:f2946dc1-ebf7-4c64-8a7a-955b4f9a7f02 for instance 6f22e1c7-5984-4649-aca5-fdc25977a831 on hv-cinder-83607 May 26 18:08:28.653656 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-a0a08831-db18-4ae4-8203-29c6d9a6d40c req-f44c6344-e2fd-4eb9-a28b-38f01c3dbad1 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 May 26 18:08:28.654252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 369/757] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:28.947344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:28.947899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:28.955157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:28.955613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:28.956373 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:28.956807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:29.022516 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:29.032646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6a4e66e2-92ff-4956-ad7f-8e6043fbbf93 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 200 len: 1331 microversion: 2.1 time: 0.089213 May 26 18:08:29.033256 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 389/758] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:28 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 1331 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:30.050681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:30.051417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:30.057811 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.058351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.059140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:30.059581 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:30.072567 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 HTTP/1.1 May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:08:30.074334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:08:30.076013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '6f22e1c7-5984-4649-aca5-fdc25977a831'} May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:08:30.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:08:30.078057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:08:30.079742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:08:30.079742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ca88825e-74ba-4c36-926c-b7e13961d609 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 404 len: 111 microversion: 2.1 time: 0.029540 May 26 18:08:30.079742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 370/759] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:30 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:08:30.084634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3175c495-b40c-43e2-b218-545cadbc1d8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '.version_select at 0x7f4b897158b0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:30.171889 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3175c495-b40c-43e2-b218-545cadbc1d8a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230929500" status: 202 len: 0 microversion: 2.1 time: 0.090949 May 26 18:08:30.172640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 390/760] 10.222.0.121 () {58 vars in 1225 bytes} [Thu May 26 18:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230929500 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:08:30.927587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4274c63d-8f6a-4001-9a24-587d3f87b43b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: .version_select at 0x7f4b89728a60>, body: {"keypair": {"name": "tempest-keypair-48959003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgXxglUp6QmusMZ/mh+qSgwLAepWN2t7Dv/MKgsqx7NRKCK+KNEiyy9W4TihxLPzApOaSGTzw6Ea/Mphvr3NM6y1H0HD+fW6PVRAUqV8Qvg8dNEZ1xqdd6UZl2tyu0y9Q=="}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:30.942127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-4274c63d-8f6a-4001-9a24-587d3f87b43b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:30.945937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-4274c63d-8f6a-4001-9a24-587d3f87b43b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:31.034639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4274c63d-8f6a-4001-9a24-587d3f87b43b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.111123 May 26 18:08:31.035266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 371/761] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:08:30 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:08:33.027596 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:33.028099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:33.034665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.035159 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.035934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.036374 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.060607 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-270a1a6c-5e4e-4a24-867c-03309776fc10 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/ips" status: 200 len: 153 microversion: 2.20 time: 0.037352 May 26 18:08:33.061164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 391/762] 10.222.0.121 () {60 vars in 1293 bytes} [Thu May 26 18:08:33 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 18:08:33.369515 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1196475700", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ccd0758f-2a58-48c2-a018-de67fccda659"}], "security_groups": [{"name": "tempest-securitygroup--232079615"}], "key_name": "tempest-keypair-48959003", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:33.472437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] validate_networks() for [('ccd0758f-2a58-48c2-a018-de67fccda659', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:08:33.841488 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:08:33.841915 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:08:33.842419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:08:33.842851 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:08:33.843274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:08:33.852149 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.852600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.853400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:33.853840 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:33.871403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:08:33.876325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Getting quotas for user 4ffcb99923b346938eb72c0b2786e815 and project 69b110a601c541328917618364dcad5b. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:08:33.886643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:08:33.889013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:08:34.039971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4a6fc876-f574-40b2-a2b7-d32cef9902b9 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.675124 May 26 18:08:34.041054 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 372/763] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:08:33 2022] POST /compute/v2.1/servers => generated 403 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:08:34.053018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9abd6b5b-fcc3-44da-bf6f-82ae4b10875a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:34.053830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9abd6b5b-fcc3-44da-bf6f-82ae4b10875a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:34.128095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9abd6b5b-fcc3-44da-bf6f-82ae4b10875a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:34.135037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9abd6b5b-fcc3-44da-bf6f-82ae4b10875a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1244 microversion: 2.1 time: 0.087632 May 26 18:08:34.135609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 392/764] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:34 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:35.153977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:35.154592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:35.161391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:35.164778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:35.164778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:35.164778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:35.223003 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:35.231170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6014390f-0c3b-427b-ab9a-7ae9805f5a1b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1248 microversion: 2.1 time: 0.082270 May 26 18:08:35.231728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 373/765] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:35 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:36.249030 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:36.249641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.256779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.257224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.258141 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.258426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.323635 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:36.331801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e75e20d6-cc25-46cf-855d-4f3fd89cb236 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1304 microversion: 2.1 time: 0.087175 May 26 18:08:36.332630 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 393/766] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:36 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1304 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:36.454616 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:36.455198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:36.461796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.462241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.463044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:36.463477 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:36.489268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lazy-loading 'flavor' on Instance uuid 909b9763-42b5-4082-986f-bdd6e4c0afa6 {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:08:37.225334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f065ac46-50a4-40f0-b843-f0ec55fcdf78 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/action" status: 202 len: 0 microversion: 2.20 time: 0.774146 May 26 18:08:37.226260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 374/767] 10.222.0.121 () {62 vars in 1323 bytes} [Thu May 26 18:08:36 2022] POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/action => generated 0 bytes in 776 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:08:37.235394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:37.236485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:37.244289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.244912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.245962 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.247407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.353927 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:37.355025 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:37.362153 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.362852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.363729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.364425 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.396206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.405864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.407534 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.409269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ace4b4ef-70a0-42db-ab76-994a3fd03d26 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.178822 May 26 18:08:37.409947 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 394/768] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:37 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:37.508607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:37.516593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-578c0bec-aeb4-4b63-b2f8-ae3de1e0697b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.166697 May 26 18:08:37.517158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 375/769] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:37 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:37.951993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-bc0833a9-2327-4a79-b9f0-3e6037727103 req-7115e050-0423-4581-9633-fd72a8b6c01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3993bd94-8215-420a-b974-205d03330383", "tag": "cdfcd365-ad55-43a6-af08-6834d18b95f1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:37.960186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-bc0833a9-2327-4a79-b9f0-3e6037727103 req-7115e050-0423-4581-9633-fd72a8b6c01d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:37.960638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-bc0833a9-2327-4a79-b9f0-3e6037727103 req-7115e050-0423-4581-9633-fd72a8b6c01d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:37.973652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-bc0833a9-2327-4a79-b9f0-3e6037727103 req-7115e050-0423-4581-9633-fd72a8b6c01d service nova] Creating event network-changed:cdfcd365-ad55-43a6-af08-6834d18b95f1 for instance 3993bd94-8215-420a-b974-205d03330383 on hv-cinder-83607 May 26 18:08:37.978969 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-bc0833a9-2327-4a79-b9f0-3e6037727103 req-7115e050-0423-4581-9633-fd72a8b6c01d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031075 May 26 18:08:37.979575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 395/770] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:38.428469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:38.429020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:38.435085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.435532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.436296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.436735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.539933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:38.541343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:38.549089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.549543 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.550584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:38.551093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:38.580388 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:38.584010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:38.585553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:38.586996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8cb6a50c-7d9f-40dc-be82-b97fa8123ef8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.162719 May 26 18:08:38.587745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 376/771] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:38 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:38.693846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:38.702364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5d90f157-02d7-460b-a2b7-7f61c4d92e2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.167199 May 26 18:08:38.703113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 396/772] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:38 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:39.607115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:39.607729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:39.614347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.614862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.615665 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.616116 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.727576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:39.728284 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:39.737215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.737716 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.738597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:39.739089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:39.987207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.995276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.997491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:39.998669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8f5a180b-c3ee-49e5-abe0-55223416d7a8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.395687 May 26 18:08:39.999243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 377/773] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:39 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:40.068613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:40.076261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f387359c-e687-4867-963f-9cd9ffdabf53 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.352643 May 26 18:08:40.076834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 397/774] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:39 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:41.017201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.017818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.024279 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.024737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.025546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.025986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.097574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:41.098232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:41.105446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.105564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.106909 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:41.107971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:41.187159 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.195730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.199592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.199592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-057b0735-db62-4a45-ac99-389a10e0e647 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.185328 May 26 18:08:41.199592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 378/775] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:41.256438 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:41.267861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-98f25389-ca95-4ce1-8497-c5192bc3089c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.172740 May 26 18:08:41.267861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 398/776] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:41 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:42.217052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:42.217697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:42.224301 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.224841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.225620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.226056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.282306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:42.283147 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:42.289922 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.290482 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.291417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:42.291892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:42.408897 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.419542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.421288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.422538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7c7a0d6c-86d1-4e8d-9b1d-128c859f0dd5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.209450 May 26 18:08:42.423210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 379/777] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:42 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:42.453389 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:42.461080 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-af7ea71e-298e-40c3-a21f-882069615602 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.182568 May 26 18:08:42.461655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 399/778] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:42 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:43.446071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.446678 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.453864 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.454316 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.455178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.455601 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.459747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.479439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:43.482052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:43.487200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.487627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.488590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:43.488903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:43.644574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.652882 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.655144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.656657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-666fc48b-18b9-46b3-89ed-df7272a0732c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.214412 May 26 18:08:43.667553 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 380/779] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:43.673869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:43.681818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6cb9dfc1-0465-4dee-adc1-f46cff524f7c tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.206319 May 26 18:08:43.682493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 400/780] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:43 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:44.675677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.677421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.678549 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.679244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=10 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.685400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.685854 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.687026 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.687483 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.700177 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:44.700809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:44.702749 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.708134 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.711719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.711719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:44.711719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:44.727888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.890770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.894889 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.899006 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.904139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:44.904139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a6d88332-9b51-4442-974a-fafd5f744bc4 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.230298 May 26 18:08:44.904558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e77c7725-73ed-4bca-b077-13066adfce51 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.206375 May 26 18:08:44.904672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 381/781] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:44.904772 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 401/782] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:44 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:45.753566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5845afa1-3ede-477e-9fea-d00e498828e9 req-fa929952-a93a-4740-a3a1-264fe1feca57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3993bd94-8215-420a-b974-205d03330383", "name": "network-vif-plugged", "status": "completed", "tag": "cdfcd365-ad55-43a6-af08-6834d18b95f1"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:45.762892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5845afa1-3ede-477e-9fea-d00e498828e9 req-fa929952-a93a-4740-a3a1-264fe1feca57 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.763336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5845afa1-3ede-477e-9fea-d00e498828e9 req-fa929952-a93a-4740-a3a1-264fe1feca57 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.774027 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5845afa1-3ede-477e-9fea-d00e498828e9 req-fa929952-a93a-4740-a3a1-264fe1feca57 service nova] Creating event network-vif-plugged:cdfcd365-ad55-43a6-af08-6834d18b95f1 for instance 3993bd94-8215-420a-b974-205d03330383 on hv-cinder-83607 May 26 18:08:45.778899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5845afa1-3ede-477e-9fea-d00e498828e9 req-fa929952-a93a-4740-a3a1-264fe1feca57 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 May 26 18:08:45.791470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 382/783] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:45.920453 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.920921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:45.921395 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.921583 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:45.924569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.928106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.928693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.929484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.929920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.930712 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.931189 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:45.931961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:45.932577 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:46.124819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.134998 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.135889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.135990 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:46.136569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-687e4558-1f84-4659-b8f8-0af64a8a8219 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.220499 May 26 18:08:46.137264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 383/784] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:46.144506 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-55ab8940-c664-4125-b193-d9bdef4cf47f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.229274 May 26 18:08:46.145210 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 402/785] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:45 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:47.154300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:47.161392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:47.161392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.161708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:47.162131 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.162326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:47.162687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.163190 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.169403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.169923 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.171034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:47.171490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:47.405742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.413644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.414163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-63411b00-a763-4a0e-860e-3bd41b4801cf tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1369 microversion: 2.1 time: 0.256352 May 26 18:08:47.414748 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 403/786] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:47 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1369 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:08:47.431620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.433111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:47.434273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b8863f8b-ac21-48bb-9459-a144e28b28e2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.284017 May 26 18:08:47.434813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 384/787] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:47 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:48.432445 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.433062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.440384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.440816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.441588 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.442024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.454286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.455591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.462798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.463289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.464268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.464714 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.647444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.653764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.656768 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7dcbc7e1-f7cc-4960-93d0-ce3ad0639a97 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1558 microversion: 2.1 time: 0.228038 May 26 18:08:48.657575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 404/788] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:08:48.663446 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.666404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:48.666548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7a7d01ca-e713-466b-8172-835610106c6c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.217111 May 26 18:08:48.667305 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 385/789] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:48.673645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:48.674165 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:48.680769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.681461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.682280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:48.682746 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:48.761896 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c19fc646-965a-4949-805f-4a7d3bc7f43d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092183 May 26 18:08:48.762526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 405/790] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:08:48 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:49.685446 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:49.686243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:49.692950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.693403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.694180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:49.694627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:49.830180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:49.838697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:49.840645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:49.842590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0dfc2db3-5f3d-4219-bf05-84f55932b545 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.160815 May 26 18:08:49.843189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 386/791] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:49 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:50.021246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-f005bb27-7bda-4bc9-84b2-1782ba86d411 req-9c67fec9-b395-4f04-aad1-65ee5ab70824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3993bd94-8215-420a-b974-205d03330383", "tag": "cdfcd365-ad55-43a6-af08-6834d18b95f1"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:50.030218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f005bb27-7bda-4bc9-84b2-1782ba86d411 req-9c67fec9-b395-4f04-aad1-65ee5ab70824 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.030666 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f005bb27-7bda-4bc9-84b2-1782ba86d411 req-9c67fec9-b395-4f04-aad1-65ee5ab70824 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.042017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-f005bb27-7bda-4bc9-84b2-1782ba86d411 req-9c67fec9-b395-4f04-aad1-65ee5ab70824 service nova] Creating event network-changed:cdfcd365-ad55-43a6-af08-6834d18b95f1 for instance 3993bd94-8215-420a-b974-205d03330383 on hv-cinder-83607 May 26 18:08:50.047871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-f005bb27-7bda-4bc9-84b2-1782ba86d411 req-9c67fec9-b395-4f04-aad1-65ee5ab70824 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030643 May 26 18:08:50.048855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 406/792] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:50.865232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:50.865857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:50.872714 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.873172 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:50.874152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:50.874510 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:51.020325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.030182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.031848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:51.033073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-47a5cbdd-4cde-43f2-adbc-c809c2b0dc05 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.172785 May 26 18:08:51.033642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 387/793] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:50 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:52.052722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:52.053536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:52.059645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.060137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.060943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:52.061912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:52.193157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:52.201202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:52.202950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:52.204115 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fbe76aa6-df2e-4ad9-b8e8-890b29518107 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.156373 May 26 18:08:52.204680 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 407/794] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:52 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:53.222376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:53.223113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:53.229696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.230142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.230921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:53.231356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:53.363952 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:53.371848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:53.373697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:53.374891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1264dd9c-250c-458d-8502-e93509bdb12c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.156459 May 26 18:08:53.375453 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 388/795] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:53 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:54.340126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-b0a711ec-ce80-4ebc-aace-af77b50355c8 req-d8b80ecd-da35-434a-825c-3893a2d461ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "name": "network-vif-plugged", "status": "completed", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:08:54.348988 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b0a711ec-ce80-4ebc-aace-af77b50355c8 req-d8b80ecd-da35-434a-825c-3893a2d461ea service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.349431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b0a711ec-ce80-4ebc-aace-af77b50355c8 req-d8b80ecd-da35-434a-825c-3893a2d461ea service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.360635 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-b0a711ec-ce80-4ebc-aace-af77b50355c8 req-d8b80ecd-da35-434a-825c-3893a2d461ea service nova] Creating event network-vif-plugged:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:08:54.365581 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-b0a711ec-ce80-4ebc-aace-af77b50355c8 req-d8b80ecd-da35-434a-825c-3893a2d461ea service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029061 May 26 18:08:54.366204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 408/796] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:08:54.392872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:54.393476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:54.395937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:54.400612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.401062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.401820 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:54.402254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:54.532541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:54.541737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:54.543285 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:54.546221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6492e9e7-9170-412e-bc69-ad21763a5091 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.155637 May 26 18:08:54.546221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 389/797] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:54 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:55.564766 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:55.565469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:55.571916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.575160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.575160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:55.575160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:55.700057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.709037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.710544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:55.711729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bf4e50eb-543f-499b-b3fc-463b445bfd3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.151743 May 26 18:08:55.712290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 409/798] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:55 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:56.730366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:56.731005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:56.738730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.739222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.739992 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:56.740432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:56.871961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.879986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.881491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:56.882644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2cf2b1cf-c699-411e-8e71-da66dc819b31 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.156687 May 26 18:08:56.883227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 390/799] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:56 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:08:57.900845 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:57.901455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:57.908745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.909200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:57.909975 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:57.910414 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:58.045294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.054413 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.056038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:58.057184 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-66e5f455-7d38-41c9-8c30-568a73666342 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1748 microversion: 2.20 time: 0.160276 May 26 18:08:58.059423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 410/800] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:57 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:08:59.076673 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:08:59.077299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:08:59.083975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.084428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:59.085196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:08:59.085631 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:08:59.217766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.225487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.227011 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:08:59.228170 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9048104b-96eb-49dc-a07b-93bdacf62f43 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.156154 May 26 18:08:59.228713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 391/801] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:08:59 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:00.246782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:00.247436 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:00.254567 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.255058 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.255817 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:00.256250 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:00.385794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.394435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.396027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:00.397179 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dae626c4-3422-4be4-b359-c33c308a5014 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.154223 May 26 18:09:00.397765 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 411/802] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:00 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:01.416247 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:01.416846 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:01.423771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.424219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.424991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:01.425685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:01.570991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.579527 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.581029 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:01.582204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9edcdf8b-f647-48f6-b2cf-4904b599bbf5 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.170132 May 26 18:09:01.582771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 392/803] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:01 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:02.601585 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:02.602160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:02.610196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:02.611040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:02.611998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:02.612744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:02.782792 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:02.792161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:02.793908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:02.795865 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-831be1db-1a07-45d2-b901-03357008d805 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.197868 May 26 18:09:02.807225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 412/804] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:02 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:03.818549 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:03.819333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:03.827502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.827938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.828748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:03.829200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:03.979779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:03.991629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:03.993492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:03.995151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-af9e3e62-454c-4da6-a113-e87679847901 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.185400 May 26 18:09:03.996519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 393/805] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:03 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:05.014355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:05.015000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:05.021526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.021981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.022777 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:05.023355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:05.157776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:05.167069 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:05.168647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:05.170872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-30db72ae-a700-4435-8cdd-6ba7268ad966 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.159653 May 26 18:09:05.171816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 413/806] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:05 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:06.190999 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:06.191591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:06.199049 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:06.199502 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.200273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:06.201608 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:06.389647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:06.398732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:06.401413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:06.402921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-74f95a91-51f7-4ef7-9018-d781aac407c2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.216369 May 26 18:09:06.406484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 394/807] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:06 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:07.421705 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:07.422305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:07.429725 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.430174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.431098 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:07.431531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:07.581822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:07.590166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:07.595314 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:07.595314 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-27c5c205-4cb8-49e9-a021-354f667e3cd2 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.175248 May 26 18:09:07.595314 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 414/808] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:07 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:08.611542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:08.612160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:08.618737 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.619231 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.620098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:08.620539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:08.770076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:08.778612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:08.780179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:08.781373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4992bfc6-1077-4c61-91e3-dcbea9e4492b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.173862 May 26 18:09:08.782038 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 395/809] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:08 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:09.800960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:09.801940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:09.827569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.827569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:09.829937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:09.830423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:10.033501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:10.044912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:10.048283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:10.049793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-967a3488-c344-4d5c-86a9-0437928fd774 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.253001 May 26 18:09:10.059370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 415/810] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:09 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:11.070324 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:11.071690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:11.080093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.080563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:11.081689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:11.082700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:11.240798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:11.254015 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:11.255627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:11.256901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5fd6a8d7-288f-487c-b9a3-16f0cea06280 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.190615 May 26 18:09:11.257522 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 396/811] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:11 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:12.277375 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:12.279133 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:12.287674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:12.288201 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:12.289037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:12.289560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:12.442088 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:12.451969 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:12.454326 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:12.455524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c0d06b86-5574-4546-b6b5-c6ed1ef9e2f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.182362 May 26 18:09:12.456243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 416/812] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:12 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:13.474160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:13.474767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:13.481315 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.482749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.482749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:13.483045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:13.501045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=100 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.615669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:13.623727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:13.625334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:13.626498 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-91fc7f19-c0c9-4f3a-8446-f852754f7d83 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1743 microversion: 2.20 time: 0.156320 May 26 18:09:13.627080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 397/813] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:13 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:14.645254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:14.645910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:14.653835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.653835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.654034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:14.654382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:14.791227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:14.800259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:14.802087 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:14.803474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1e9b0b50-d472-454b-8b7c-8c45594d9e6a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1725 microversion: 2.20 time: 0.162426 May 26 18:09:14.804174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 417/814] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:14 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:15.821286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:15.821900 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:15.828977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.829424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.830187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:15.830626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:15.965108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:15.973705 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:15.975249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:15.976418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2d5873c3-d125-4224-8adb-72106931fff6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1725 microversion: 2.20 time: 0.158967 May 26 18:09:15.976975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 398/815] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:15 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:16.994884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:16.995424 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:16.997996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=32 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.004782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.005232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.005996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.006601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.143474 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:17.151538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:17.153103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:17.154261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5964bada-c06c-48fb-9fad-7388e79ed64a tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1728 microversion: 2.20 time: 0.163431 May 26 18:09:17.154838 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 418/816] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:16 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:17.172468 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c3b1ca4-0416-4705-9bce-4e4ed9f7197d"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:17.173525 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:17.180701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.181157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:17.181933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:17.182373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.327678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-04aceab9-e2c3-4406-a70e-90ae846a22e9 req-981a772e-2438-4754-955c-592f48b2567b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "name": "network-vif-unplugged", "status": "completed", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:18.336349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-04aceab9-e2c3-4406-a70e-90ae846a22e9 req-981a772e-2438-4754-955c-592f48b2567b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.336732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-04aceab9-e2c3-4406-a70e-90ae846a22e9 req-981a772e-2438-4754-955c-592f48b2567b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.340441 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=95 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.347682 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.compute.server_external_events [req-04aceab9-e2c3-4406-a70e-90ae846a22e9 req-981a772e-2438-4754-955c-592f48b2567b service nova] Unable to find a host for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6. Dropping event network-vif-unplugged {{(pid=130099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 18:09:18.351233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-04aceab9-e2c3-4406-a70e-90ae846a22e9 req-981a772e-2438-4754-955c-592f48b2567b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024826 May 26 18:09:18.351233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 419/817] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 18:09:18.557559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-db44f240-ec79-44ca-8052-2ef362ae5581 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.388921 May 26 18:09:18.558307 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 399/818] 10.222.0.121 () {62 vars in 1368 bytes} [Thu May 26 18:09:17 2022] POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments => generated 188 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 18:09:18.676864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:18.677364 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:18.683713 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.684166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:18.689333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:18.689333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.392791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-22726b99-443e-406a-b12a-bec501b9323d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments/0c3b1ca4-0416-4705-9bce-4e4ed9f7197d" status: 202 len: 0 microversion: 2.20 time: 0.720431 May 26 18:09:19.394455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 420/819] 10.222.0.121 () {60 vars in 1461 bytes} [Thu May 26 18:09:18 2022] DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments/0c3b1ca4-0416-4705-9bce-4e4ed9f7197d => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 18:09:19.463358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:19.464044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.472021 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.472653 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.473514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.474056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.941966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-42b631cc-d3eb-4204-b96a-34462ee20827 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/action" status: 202 len: 0 microversion: 2.20 time: 0.482585 May 26 18:09:19.943430 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 400/820] 10.222.0.121 () {62 vars in 1323 bytes} [Thu May 26 18:09:19 2022] POST /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 18:09:19.952075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:19.953049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:19.963038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.963038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:19.963038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:19.963038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:20.169141 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.178540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.181172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:20.189214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-42d29c47-f9cd-496b-95b6-9404d3b5dd6d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1676 microversion: 2.20 time: 0.234877 May 26 18:09:20.189214 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 421/821] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:19 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:21.200937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:21.202269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:21.210759 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.211501 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.212525 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:21.212960 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:21.437699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.448073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.449607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:21.450767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5d919619-bf1e-405f-8cb6-af8dd19948f0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1676 microversion: 2.20 time: 0.253982 May 26 18:09:21.451347 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 401/822] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:21 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1676 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:22.469505 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:22.473604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:22.485035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.485803 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.488771 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:22.489223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:22.707805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.717773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.719559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:22.720781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9bf518eb-bfc2-44d5-abbf-8a078e48e522 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.255192 May 26 18:09:22.721351 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 422/823] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:22 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:23.742893 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:23.744298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:23.752641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.753481 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:23.754531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:23.755227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:24.048454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.063351 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.065062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:24.067084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d69d1b0e-01fd-48a7-b14c-9415b5e0e327 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.328190 May 26 18:09:24.083245 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 402/824] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:23 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:25.085744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:25.086512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:25.094659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.099014 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.100565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:25.101984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:25.279661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.291860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.294053 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:25.296188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5cf03559-803f-48d0-8b64-e160e912a32c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.214442 May 26 18:09:25.307783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 423/825] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:25 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:26.317818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:26.318565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:26.340620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.341299 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.342134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:26.343442 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:26.642329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.655751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.657269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:26.658497 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-baaa0f56-4a39-4db6-b128-43e4484c06a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.345436 May 26 18:09:26.659829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 403/826] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:26 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:27.678472 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:27.686933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:27.699300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.703455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.703455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:27.703455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:27.947554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.965590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.973321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:27.975000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ab5ed1c0-4aa3-4920-8fd3-26e2ffc3c1a0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.301334 May 26 18:09:27.977544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 424/827] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:27 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:28.995623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:28.997725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:29.000712 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=32 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:29.007775 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.008490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.009504 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:29.010251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:29.254654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:29.264887 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:29.266558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:29.268013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-08e5ad3a-1330-43ee-99d0-bdb633fd305c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.278219 May 26 18:09:29.275604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 404/828] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:28 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:30.293285 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:30.295172 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:30.308899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.309660 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.313447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:30.314698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:30.753262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:30.762307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:30.771893 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:30.777222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0bc2bd79-2081-4037-a1a0-db0609808b66 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.487277 May 26 18:09:30.796134 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 425/829] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:30 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:31.809637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:31.813756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:31.830654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:31.835544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:31.836614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:31.837246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:32.433780 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:32.448532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:32.450248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:32.453274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ae475238-441d-4133-a5a2-6655e533a0f8 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.652458 May 26 18:09:32.456292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 405/830] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:31 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:33.473434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:33.474055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:33.480538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.480928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.481692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:33.482126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:33.620553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:33.629152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:33.630757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:33.636971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4e31ee11-42e7-49b9-a75c-dfd2b28edeef tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.162479 May 26 18:09:33.636971 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 426/831] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:33 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:09:33.730667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-52cc4906-e3b1-469e-a9b2-681cec26f49d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Action: 'create', calling method: .version_select at 0x7f4b898829d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-303959824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIZ0H9SW0DCweY0Vsx7AGT5q3L+/jQVYRe6yeds9SfEB67+xJoRDK7c1FwubYP7u1ty+D/tceEFlj4sHhPB7Kf1vogVL8YkgyPgiud7opw+igfC/h/Dguj5Zped1zV2tg=="}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:33.745236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-52cc4906-e3b1-469e-a9b2-681cec26f49d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for project 7daf2a694ab840949d8cf403c2573bda. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:09:33.748962 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-52cc4906-e3b1-469e-a9b2-681cec26f49d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for user e7e74d9bfa6144ae8ad7e3156fb42e6e and project 7daf2a694ab840949d8cf403c2573bda. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:09:33.817120 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-52cc4906-e3b1-469e-a9b2-681cec26f49d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.252856 May 26 18:09:33.817645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 406/832] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:09:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:09:34.650075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:34.650685 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:34.657285 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.657735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.658496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:34.658972 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:34.798430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:34.807440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:34.809022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:34.810265 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-19dcd092-ec1a-4e84-b842-6e7dd6d2bd22 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.164203 May 26 18:09:34.810975 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 427/833] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:34 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:35.830474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:35.832067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:35.840622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:35.840622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:35.841100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:35.841554 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:35.995416 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:36.005623 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:36.007296 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:36.008750 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-049ad6dd-482b-4bb6-93b3-3d825c525fc3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.183522 May 26 18:09:36.016276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 407/834] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:35 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:37.032458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:37.033147 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:37.040494 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:37.046406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:37.046406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:37.046406 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:37.186758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:37.196157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:37.197787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:37.199104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-95aa683e-75e0-48ba-822e-8a83ef62bdd3 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.170689 May 26 18:09:37.199746 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 428/835] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:37 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:38.216791 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:38.217431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:38.225976 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:38.225976 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:38.226548 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:38.227027 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:38.368624 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:38.377756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:38.379331 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:38.380493 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fc82d459-5aeb-4471-baac-c55b272de6c1 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.167609 May 26 18:09:38.381082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 408/836] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:38 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:39.399606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:39.400218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:39.406779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:39.407278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:39.408073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:39.408533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:39.649781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:39.657825 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:39.659339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:39.660817 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1051773c-51c5-4f7b-8027-eceb42aa4b3e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.265222 May 26 18:09:39.661375 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 429/837] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:39 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:40.679589 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:40.680334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:40.687075 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:40.687528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:40.688303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:40.688742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:40.824629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:40.833030 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:40.834660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:40.835939 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5da0f308-5b87-4590-88b2-c3bf90816e13 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.161214 May 26 18:09:40.836650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 409/838] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:40 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:41.853953 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:41.854568 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:41.861220 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:41.861676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:41.862456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:41.862929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:42.003048 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:42.011570 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:42.013055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:42.014200 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-86e8cbde-d38a-4092-9976-22e9e65cfe8b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.164606 May 26 18:09:42.014757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 430/839] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:41 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:42.464784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-bed9a149-2c8d-4580-ae35-c66b22c6708c req-0197e85f-d390-4fd0-9f06-22136d010be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "name": "network-vif-plugged", "status": "completed", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:09:42.473947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-bed9a149-2c8d-4580-ae35-c66b22c6708c req-0197e85f-d390-4fd0-9f06-22136d010be4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:42.474400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-bed9a149-2c8d-4580-ae35-c66b22c6708c req-0197e85f-d390-4fd0-9f06-22136d010be4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:42.486903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-bed9a149-2c8d-4580-ae35-c66b22c6708c req-0197e85f-d390-4fd0-9f06-22136d010be4 service nova] Creating event network-vif-plugged:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:09:42.492860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-bed9a149-2c8d-4580-ae35-c66b22c6708c req-0197e85f-d390-4fd0-9f06-22136d010be4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 May 26 18:09:42.493450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 410/840] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:09:42.712654 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:09:42.712882 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:09:43.033737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:43.034429 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:43.041352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:43.041813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:43.042579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:43.043045 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:43.183334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:43.193386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:43.195818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:43.196991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-743876b2-d2e3-46ad-91eb-f38e1c124b0c tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.167279 May 26 18:09:43.197554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 431/841] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:43 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:44.216287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:44.216897 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:44.219315 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=4 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:44.224372 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:44.227369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:44.227369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:44.227369 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:44.229158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:44.420571 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:44.429137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:44.430725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:44.432008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1027a545-d6b7-4705-959d-476f9fd0c7b0 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.220024 May 26 18:09:44.432669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 411/842] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:44 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:09:45.450652 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:45.451280 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:45.458031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:45.458483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:45.459281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:45.459724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:45.600667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:45.610488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:45.612032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:45.613186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6755cb1e-0538-4406-9834-8d1abdaa7b75 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1734 microversion: 2.20 time: 0.167278 May 26 18:09:45.613735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 432/843] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:45 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:09:46.631565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:09:46.632125 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:09:46.639038 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.639544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.646096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:09:46.646096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:09:46.782169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:46.791177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:46.793185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:09:46.794363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b0edf78f-bf92-462b-a1d9-1be7b49ce153 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1721 microversion: 2.20 time: 0.167008 May 26 18:09:46.795024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 412/844] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:09:46 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:00.915338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1844487025", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303959824", "security_groups": [{"name": "tempest-secgroup-smoke-142513058"}], "block_device_mapping_v2": [{"uuid": "cdaacd4e-3d02-4b25-8a77-ce20c6fc32a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8063d2c8-f54f-4352-9b7a-ae641c155ce0"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:00.923801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=29 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:00.924590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:01.027542 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] validate_networks() for [('8063d2c8-f54f-4352-9b7a-ae641c155ce0', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:10:01.447556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:10:01.447986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:10:01.448519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:10:01.448936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:10:01.449354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:10:01.458835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.459294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.460331 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:01.460770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:01.478056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:10:01.482295 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for user e7e74d9bfa6144ae8ad7e3156fb42e6e and project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:10:01.539879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:10:01.541932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdaacd4e-3d02-4b25-8a77-ce20c6fc32a0',volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:10:01.978425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-590d9f2e-2a0c-491f-a458-b03a9aa3bad6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.066757 May 26 18:10:01.979269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 433/845] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:10:00 2022] POST /compute/v2.1/servers => generated 407 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:10:01.990261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a03938a2-d93f-4e20-ad4a-a985558b1341 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:01.990906 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a03938a2-d93f-4e20-ad4a-a985558b1341 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:01.993582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:01.994276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=11 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:02.045691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a03938a2-d93f-4e20-ad4a-a985558b1341 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:02.053535 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a03938a2-d93f-4e20-ad4a-a985558b1341 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1097 microversion: 2.1 time: 0.067296 May 26 18:10:02.054112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 413/846] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:01 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1097 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:03.070418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e23e61dc-8717-4fe0-ae4c-e58a8dcb9722 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:03.071062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e23e61dc-8717-4fe0-ae4c-e58a8dcb9722 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:03.123902 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e23e61dc-8717-4fe0-ae4c-e58a8dcb9722 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:03.131294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e23e61dc-8717-4fe0-ae4c-e58a8dcb9722 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1097 microversion: 2.1 time: 0.064799 May 26 18:10:03.131846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 434/847] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:03 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1097 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:04.148872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:04.149711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:04.157802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.158274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.159099 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:04.159544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:04.223259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:04.230704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cd2412ea-e051-4025-ac52-47c6bbe91ba5 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1195 microversion: 2.1 time: 0.086433 May 26 18:10:04.232487 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 414/848] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:04 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:05.250039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:05.250722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:05.257914 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.261888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.261888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:05.261888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:05.403070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:05.415911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a604327d-7cd6-4000-ac56-490a1f36ae8e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1280 microversion: 2.1 time: 0.169646 May 26 18:10:05.418309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 435/849] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:05 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:06.230850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-d03e3170-23af-478c-b436-43da60cfa03b req-8393338f-f02d-4e1f-b3b4-7cc3350673a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c61ea-ea27-4ef4-a252-9e4893a80974", "tag": "28bc8818-a564-40ef-b786-1e12f252e269"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:06.241070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d03e3170-23af-478c-b436-43da60cfa03b req-8393338f-f02d-4e1f-b3b4-7cc3350673a5 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.241519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d03e3170-23af-478c-b436-43da60cfa03b req-8393338f-f02d-4e1f-b3b4-7cc3350673a5 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.259225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-d03e3170-23af-478c-b436-43da60cfa03b req-8393338f-f02d-4e1f-b3b4-7cc3350673a5 service nova] Creating event network-changed:28bc8818-a564-40ef-b786-1e12f252e269 for instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 on hv-cinder-83607 May 26 18:10:06.264609 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-d03e3170-23af-478c-b436-43da60cfa03b req-8393338f-f02d-4e1f-b3b4-7cc3350673a5 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037952 May 26 18:10:06.265441 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 415/850] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:06.433230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:06.434510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:06.441575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.442037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.443002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:06.443282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:06.575874 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:06.584015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cfde6fcb-3970-49b0-87aa-4d368a7cc1b8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.154590 May 26 18:10:06.584590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 436/851] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:06 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:07.602588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:07.603338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:07.609728 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:07.611803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:07.611803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:07.611803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:07.745183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:07.753163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-89a80ce2-7d99-4b5a-8942-1a97896b9ff9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.155121 May 26 18:10:07.753726 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 416/852] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:07 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:08.769199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:08.769808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:08.776340 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:08.776793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:08.777558 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:08.778000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:08.906446 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:08.914863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-65a9b858-f875-4924-8fe6-b146890b626e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.149453 May 26 18:10:08.915451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 437/853] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:08 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:09.931953 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:09.932565 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:09.939010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.940366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:09.941162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:09.941604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:10.072024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:10.079555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5911c952-e3e8-4b4b-aff0-34e746793da9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.151429 May 26 18:10:10.083857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 417/854] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:09 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:11.097142 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:11.097769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:11.104661 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.105119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.105903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:11.106343 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:11.249557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:11.249557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bfd77225-3794-4ab6-874b-d6fb42e12fa2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.156049 May 26 18:10:11.249799 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 438/855] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:11 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:12.265987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:12.266593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:12.269224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:12.274251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.274697 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:12.275909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:12.275909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:12.409003 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:12.419137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8ff8a896-ba20-41f9-a38a-3ea13e67034f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.156810 May 26 18:10:12.419753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 418/856] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:12 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:13.437158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:13.437788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:13.439684 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:13.441475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=8 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:13.446250 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.450428 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.450428 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:13.450428 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:13.582447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:13.589932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2dd043d3-9e5f-49e6-8f17-8897727fcf15 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.156669 May 26 18:10:13.590489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 439/857] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:13 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:14.606679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:14.607424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:14.614068 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.614658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.615672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:14.616115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:14.747367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:14.754704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-003d3824-016c-44a0-afe9-18f19c82eede tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.151909 May 26 18:10:14.755787 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 419/858] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:14 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:15.773485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:15.774040 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:15.781293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.781745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.782509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:15.782977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:15.916763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:15.924319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a8f884c0-27a0-474b-a900-f854ded7245b tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.156040 May 26 18:10:15.924921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 440/859] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:15 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:16.941523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:16.942069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:16.949239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.949724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:16.950508 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:16.950996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:17.085243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:17.092977 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d76ad4ff-4ecf-4f01-a5ec-ffded26350fd tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.155371 May 26 18:10:17.093630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 420/860] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:16 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:18.110389 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:18.111034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:18.117892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.118347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.119176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.119619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.248338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:18.256194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-92950169-430b-4e76-96b1-258043343a9f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.149666 May 26 18:10:18.256820 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 441/861] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:18 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:18.782365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5832daef-b5ad-4abf-a539-d957279ddc39 req-d09f9286-3096-4661-8fe1-d01f77e616d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3c61ea-ea27-4ef4-a252-9e4893a80974", "name": "network-vif-plugged", "status": "completed", "tag": "28bc8818-a564-40ef-b786-1e12f252e269"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:18.791403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5832daef-b5ad-4abf-a539-d957279ddc39 req-d09f9286-3096-4661-8fe1-d01f77e616d4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:18.791848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5832daef-b5ad-4abf-a539-d957279ddc39 req-d09f9286-3096-4661-8fe1-d01f77e616d4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:18.803470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5832daef-b5ad-4abf-a539-d957279ddc39 req-d09f9286-3096-4661-8fe1-d01f77e616d4 service nova] Creating event network-vif-plugged:28bc8818-a564-40ef-b786-1e12f252e269 for instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 on hv-cinder-83607 May 26 18:10:18.812205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5832daef-b5ad-4abf-a539-d957279ddc39 req-d09f9286-3096-4661-8fe1-d01f77e616d4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030100 May 26 18:10:18.812205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 421/862] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:19.273363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.273999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.280611 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.281065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.281835 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.282271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.413264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:19.420824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-66f81590-d750-42c5-9cfc-d3bad30ab346 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.151365 May 26 18:10:19.421415 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 442/863] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:19.656529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:19.657113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:19.663596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.664052 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.664856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:19.665306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:19.688359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-74d59e7d-dd14-4f16-9d03-67535799417a tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/ips" status: 200 len: 148 microversion: 2.1 time: 0.036086 May 26 18:10:19.688935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 422/864] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:10:19 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:20.441902 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:20.442512 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:20.449510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.454302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.454302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:20.454302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:20.582995 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:20.591830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9b151b7e-eefc-458e-b61a-cd9b7b9787c4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1268 microversion: 2.1 time: 0.157192 May 26 18:10:20.597366 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 443/865] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:20 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:21.269939 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbaf15f0-82f5-4517-9435-8e05e7d7dff3"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:21.271033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:21.278734 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.279239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.280047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.280485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.608711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:21.609398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:21.616160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.621804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.621804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.621804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.753165 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:21.761872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0d0f87d0-6e68-411f-8b68-498fba87a395 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1455 microversion: 2.1 time: 0.157217 May 26 18:10:21.762440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 444/866] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:21 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:21.782688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:21.783331 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:21.789291 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.789951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.790724 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:21.791190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:21.923716 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:21.932433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7690361b-e449-4796-bbb4-0003dd47494d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1455 microversion: 2.1 time: 0.153277 May 26 18:10:21.932999 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 445/867] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:21 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:10:22.065435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5683027c-adfc-4467-b08b-c538b5634d59 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "POST /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799308 May 26 18:10:22.066040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 423/868] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:10:21 2022] POST /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:24.318091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-e1dc8d5f-6f8e-48e2-a5c7-068339eada24 req-0621b425-c315-43e6-8d42-6375e0bfe290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c61ea-ea27-4ef4-a252-9e4893a80974", "tag": "28bc8818-a564-40ef-b786-1e12f252e269"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:24.326738 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-e1dc8d5f-6f8e-48e2-a5c7-068339eada24 req-0621b425-c315-43e6-8d42-6375e0bfe290 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:24.329153 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-e1dc8d5f-6f8e-48e2-a5c7-068339eada24 req-0621b425-c315-43e6-8d42-6375e0bfe290 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:24.496677 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-e1dc8d5f-6f8e-48e2-a5c7-068339eada24 req-0621b425-c315-43e6-8d42-6375e0bfe290 service nova] Creating event network-changed:28bc8818-a564-40ef-b786-1e12f252e269 for instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 on hv-cinder-83607 May 26 18:10:24.501842 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-e1dc8d5f-6f8e-48e2-a5c7-068339eada24 req-0621b425-c315-43e6-8d42-6375e0bfe290 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250799 May 26 18:10:24.502523 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 446/869] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:29.663489 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:29.664094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:29.671220 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.671677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.672457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:29.672898 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:29.754376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'services' on Instance uuid 3993bd94-8215-420a-b974-205d03330383 {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:29.986334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-63143765-a087-4292-a3e4-71c7c3a3317d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments/bbaf15f0-82f5-4517-9435-8e05e7d7dff3" status: 202 len: 0 microversion: 2.1 time: 0.327593 May 26 18:10:29.986910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 424/870] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:10:29 2022] DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments/bbaf15f0-82f5-4517-9435-8e05e7d7dff3 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:29.997744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:29.998849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:30.005017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.006676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.006676 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:30.006910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:30.035730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d07610d9-327b-4c52-bf27-4e5f85ea46e0 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 May 26 18:10:30.036272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 447/871] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:10:29 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:31.049268 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:31.050361 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:31.057878 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:31.058338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:31.059615 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:31.059794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:31.091568 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-09aa5932-9079-42eb-b826-a1237e59ce2d tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 May 26 18:10:31.092171 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 425/872] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:10:31 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:32.104369 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:32.105344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:32.107891 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:32.112674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.113129 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.113901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.114344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.118656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=77 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:32.143851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a5157ecd-4bf6-47d3-a48c-728d1a6de520 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044163 May 26 18:10:32.144404 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 448/873] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:10:32 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:10:32.205048 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:32.205557 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:32.212047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.212505 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.213271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.213715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.238746 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:32.644208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9005aaf4-460a-44df-a754-bc5792214e29 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 204 len: 0 microversion: 2.1 time: 0.442732 May 26 18:10:32.644795 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 426/874] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:10:32 2022] DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:10:32.654170 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:32.658470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:32.661454 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.661908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.662671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:32.663137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:32.795215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:32.802839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e469976e-7549-404a-b2a4-1c31018571a7 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1682 microversion: 2.1 time: 0.152717 May 26 18:10:32.803398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 449/875] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:32 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:33.821808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:33.822529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:33.829008 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:33.829463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:33.830229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:33.830667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:33.962778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:33.970401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5908f8c6-701f-4454-969c-7ce27cd42cbc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1682 microversion: 2.1 time: 0.153469 May 26 18:10:33.970990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 427/876] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:33 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:34.988246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:34.989124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:34.996240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:34.996696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:34.997483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:34.997924 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.135293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:35.142909 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7b745f9b-f2d4-40d1-9ca9-dcc981074e5f tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1682 microversion: 2.1 time: 0.158761 May 26 18:10:35.143544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 450/877] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:34 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:35.540536 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-ec1909a7-55c5-4233-88a5-45b6afdb1aec req-4b18eafb-4aa1-4bdb-ae97-d07b88411af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3993bd94-8215-420a-b974-205d03330383", "name": "network-vif-deleted", "tag": "cdfcd365-ad55-43a6-af08-6834d18b95f1"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:35.544493 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:35.549611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ec1909a7-55c5-4233-88a5-45b6afdb1aec req-4b18eafb-4aa1-4bdb-ae97-d07b88411af8 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:35.550063 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-ec1909a7-55c5-4233-88a5-45b6afdb1aec req-4b18eafb-4aa1-4bdb-ae97-d07b88411af8 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:35.554083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:35.562114 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-ec1909a7-55c5-4233-88a5-45b6afdb1aec req-4b18eafb-4aa1-4bdb-ae97-d07b88411af8 service nova] Creating event network-vif-deleted:cdfcd365-ad55-43a6-af08-6834d18b95f1 for instance 3993bd94-8215-420a-b974-205d03330383 on hv-cinder-83607 May 26 18:10:35.567010 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-ec1909a7-55c5-4233-88a5-45b6afdb1aec req-4b18eafb-4aa1-4bdb-ae97-d07b88411af8 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030178 May 26 18:10:35.567599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 428/878] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:36.160562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:36.161193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:36.168991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.169449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.170233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.170674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.203408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:36.203862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:36.204321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lazy-loading 'fault' on Instance uuid 3993bd94-8215-420a-b974-205d03330383 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:10:36.256152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ffcb99923b346938eb72c0b2786e815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69b110a601c541328917618364dcad5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:36.264287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f0cb05bc-13bc-4f1a-a7b8-6e02fb3adbe4 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 200 len: 1334 microversion: 2.1 time: 0.107589 May 26 18:10:36.264854 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 451/879] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:36 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:37.283636 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:37.284333 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:37.292620 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:37.293106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:37.293878 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:37.294323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:37.308238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 HTTP/1.1 May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:10:37.309891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:37.311559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '3993bd94-8215-420a-b974-205d03330383'} May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:37.312476 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:37.314064 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:37.315872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:37.315872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5d5f5f6a-c716-4b12-b001-aa70d2204896 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 404 len: 111 microversion: 2.1 time: 0.032483 May 26 18:10:37.315872 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 429/880] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:37 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:37.320187 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bb14983e-c674-481b-af92-0fcacebbd918 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '.version_select at 0x7f4b898358b0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:37.439576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bb14983e-c674-481b-af92-0fcacebbd918 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48959003" status: 202 len: 0 microversion: 2.1 time: 0.123002 May 26 18:10:37.440176 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 452/881] 10.222.0.121 () {58 vars in 1219 bytes} [Thu May 26 18:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48959003 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:10:39.521432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:39.521930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:39.530463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.530942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.531711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.532155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.545704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 HTTP/1.1 May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:10:39.547286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.548850 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '3993bd94-8215-420a-b974-205d03330383'} May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:39.549889 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.551466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:39.553330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:39.553330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b862a717-72dc-4d39-b94c-59bd93465f73 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 404 len: 111 microversion: 2.1 time: 0.031026 May 26 18:10:39.553330 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 430/882] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:10:39 2022] DELETE /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:39.559270 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:39.562901 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 3993bd94-8215-420a-b974-205d03330383] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:39.566559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.567161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.567938 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:39.568382 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:39.584080 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 HTTP/1.1 May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:10:39.585818 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.588163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '3993bd94-8215-420a-b974-205d03330383'} May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:39.589026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. May 26 18:10:39.590638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:39.592096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 3993bd94-8215-420a-b974-205d03330383 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:39.592096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-663957e6-ba3c-412e-8cdc-28bd909c0ea1 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383" status: 404 len: 111 microversion: 2.1 time: 0.032516 May 26 18:10:39.592096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 453/883] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:39 2022] GET /compute/v2.1/servers/3993bd94-8215-420a-b974-205d03330383 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:40.877693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.878196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.884942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.885399 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.886171 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.886617 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.900122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 HTTP/1.1 May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:10:40.901701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.903284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '6f22e1c7-5984-4649-aca5-fdc25977a831'} May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:40.904160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.905614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.907135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:40.907135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2ca2362d-4871-4f4e-928f-377f0593d8dd tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 404 len: 111 microversion: 2.1 time: 0.029611 May 26 18:10:40.907135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 431/884] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:10:40 2022] DELETE /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:40.911420 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.912034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 6f22e1c7-5984-4649-aca5-fdc25977a831] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.919299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.919731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.920491 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.920932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.934763 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 HTTP/1.1 May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:10:40.936306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.937787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '6f22e1c7-5984-4649-aca5-fdc25977a831'} May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:40.938647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. May 26 18:10:40.940097 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:40.941426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 6f22e1c7-5984-4649-aca5-fdc25977a831 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:40.941426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a0046eb2-c4d2-40b5-b554-cf90965a6c82 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831" status: 404 len: 111 microversion: 2.1 time: 0.030077 May 26 18:10:40.941426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 454/885] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:40 2022] GET /compute/v2.1/servers/6f22e1c7-5984-4649-aca5-fdc25977a831 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:10:40.946202 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.946702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.953191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.953640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.954412 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.954886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.968719 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 HTTP/1.1 May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:10:40.970267 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:40.971802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '7ee5f274-1ed9-4543-a4c3-fbc71cfe3453'} May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:40.972651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:40.974067 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:40.975460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:40.975460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8bf9989d-dc7b-4c06-bad2-1e0a5b8a3abc tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 404 len: 111 microversion: 2.1 time: 0.029337 May 26 18:10:40.975460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 432/886] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:10:40 2022] DELETE /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:40.980697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:40.981328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:40.987258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.987711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:40.988463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:40.988899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:41.002447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 HTTP/1.1 May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:10:41.003998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:41.005557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '7ee5f274-1ed9-4543-a4c3-fbc71cfe3453'} May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:41.006565 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. May 26 18:10:41.008104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:41.009584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance 7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:41.009584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9d5b82b9-13cc-4c50-9ea3-e718954d0e87 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453" status: 404 len: 111 microversion: 2.1 time: 0.029146 May 26 18:10:41.009584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 455/887] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:40 2022] GET /compute/v2.1/servers/7ee5f274-1ed9-4543-a4c3-fbc71cfe3453 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:42.320513 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:42.321134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:42.327951 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:42.328409 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:42.329174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:42.329612 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:42.343687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab HTTP/1.1 May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:10:42.345266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.346800 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': 'a948f2ab-1a7a-4cee-b600-643f1902a6ab'} May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:42.347713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.349252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:10:42.350935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:42.350935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6da3de5e-2dc1-4f06-920c-264253d1670b tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 404 len: 111 microversion: 2.1 time: 0.030127 May 26 18:10:42.350935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 433/888] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:10:42 2022] DELETE /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:42.355726 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:42.361071 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] [instance: a948f2ab-1a7a-4cee-b600-643f1902a6ab] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:42.363050 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:42.363496 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:42.364286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:42.364743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:42.378876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] HTTP exception thrown: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Request method failure captured: May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab HTTP/1.1 May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AcUcCXpPfMkH1aVQrTbQmzU2Vs40KWg9h7ZSRS40xCLeoMNjIls3Enf4tE5rIGvnaj1Jbd_bNksQgJv25x0OnUA3HEVrOyixVzRz3aZ60Z0Dc869F9oOBhYzxWg1YN5rsSc7ooj9rfEJyYLjTDExBp2Nw62Q-7jG-DkH4yx2Xt0Hk May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 69b110a601c541328917618364dcad5b May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:10:42.380422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/69b110a601c541328917618364dcad5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/69b110a601c541328917618364dcad5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_69b110a601c541328917618364dcad5b", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 69b110a601c541328917618364dcad5b May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233010223 May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 4ffcb99923b346938eb72c0b2786e815 May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeNegativeTest-233010223-project May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.382016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'a948f2ab-1a7a-4cee-b600-643f1902a6ab'} May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:10:42.382791 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. May 26 18:10:42.384131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:10:42.385519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] Returning 404 to user: Instance a948f2ab-1a7a-4cee-b600-643f1902a6ab could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:10:42.385519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ca2fecfd-dfbc-4f30-94d7-64ad2038f919 tempest-AttachVolumeNegativeTest-233010223 tempest-AttachVolumeNegativeTest-233010223-project] 10.222.0.121 "GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab" status: 404 len: 111 microversion: 2.1 time: 0.030555 May 26 18:10:42.385519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 456/889] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:10:42 2022] GET /compute/v2.1/servers/a948f2ab-1a7a-4cee-b600-643f1902a6ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:10:55.889375 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.890295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:55.892831 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=11 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.893465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=11 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.898675 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.902744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.902744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:55.902744 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:55.931174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5dc3ffbe-d312-4c64-a567-6002601fc840 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045706 May 26 18:10:55.932637 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 434/890] 10.222.0.121 () {60 vars in 1347 bytes} [Thu May 26 18:10:55 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:10:55.991455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:55.991996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:55.994162 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.994967 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=33 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:55.999792 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.000240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.001051 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.001487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.026122 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:10:56.289410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-22835b23-2509-48b8-85f4-3f82331b2209 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 204 len: 0 microversion: 2.20 time: 0.301655 May 26 18:10:56.289991 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 457/891] 10.222.0.121 () {60 vars in 1284 bytes} [Thu May 26 18:10:55 2022] DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:10:56.298679 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:56.299319 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:56.306866 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.307318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.311062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:56.311062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:56.442496 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.450703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.452312 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:56.453474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f2e207fa-5639-4576-be3e-4ee8f9c50373 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.159088 May 26 18:10:56.454020 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 435/892] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:10:56 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 18:10:57.472597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:57.473347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:57.479910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.481038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.481870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:57.482313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:57.617242 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.625887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.627418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:57.628574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-93e812f1-cb88-4707-8039-46622bee58a6 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.160402 May 26 18:10:57.629126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 458/893] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:10:57 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:58.646365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:58.647644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:58.657264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.657926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.658971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:58.659610 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:58.808193 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.817057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.818561 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:58.830607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b42d2661-154d-44b7-9267-c9527b0b1e00 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1727 microversion: 2.20 time: 0.177948 May 26 18:10:58.830607 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 436/894] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:10:58 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:10:59.537395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-a08a115a-534d-42fb-8df5-0dc0777554c4 req-f99240b3-197c-414d-98a8-5db20da25b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "909b9763-42b5-4082-986f-bdd6e4c0afa6", "name": "network-vif-deleted", "tag": "0c6e1851-a2a7-44d3-ad04-dcbad554d9b9"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:10:59.546802 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-a08a115a-534d-42fb-8df5-0dc0777554c4 req-f99240b3-197c-414d-98a8-5db20da25b0b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.547449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-a08a115a-534d-42fb-8df5-0dc0777554c4 req-f99240b3-197c-414d-98a8-5db20da25b0b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.559509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-a08a115a-534d-42fb-8df5-0dc0777554c4 req-f99240b3-197c-414d-98a8-5db20da25b0b service nova] Creating event network-vif-deleted:0c6e1851-a2a7-44d3-ad04-dcbad554d9b9 for instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 on hv-cinder-83607 May 26 18:10:59.569031 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-a08a115a-534d-42fb-8df5-0dc0777554c4 req-f99240b3-197c-414d-98a8-5db20da25b0b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035046 May 26 18:10:59.570386 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 459/895] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:10:59.839115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:10:59.840335 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:10:59.847157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.847663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.848537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:10:59.849045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:10:59.914180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.928012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.931171 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fe1c86c411834f1c8d2775a5b2c5f1d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68bd0110e4fd4e6dbef9f65397908292', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:10:59.933348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ac3da86b-2296-4c38-b795-eef812a47e7d tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 200 len: 1369 microversion: 2.20 time: 0.098014 May 26 18:10:59.934440 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 437/896] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:10:59 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 18:11:00.954840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:00.955532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:00.961639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.962089 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.962863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:00.963363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:00.976833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 HTTP/1.1 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:11:00.978466 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:00.980293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '909b9763-42b5-4082-986f-bdd6e4c0afa6'} May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:00.981204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:00.982668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:00.984178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:00.984178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4dc281db-7500-4003-a069-d9575584d0cb tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 404 len: 111 microversion: 2.20 time: 0.029667 May 26 18:11:00.984178 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 460/897] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:11:00 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:11:00.989178 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-90bb3231-a03d-4f80-b54a-4aee534a2dfd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '.version_select at 0x7f4b898cb160>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:01.113647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-90bb3231-a03d-4f80-b54a-4aee534a2dfd tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296772945" status: 204 len: 0 microversion: 2.20 time: 0.128336 May 26 18:11:01.114308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 438/898] 10.222.0.121 () {60 vars in 1263 bytes} [Thu May 26 18:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296772945 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 18:11:03.127495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:03.128029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:03.135567 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.136025 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.137196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.137703 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.151099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 HTTP/1.1 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:11:03.152721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.154323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '909b9763-42b5-4082-986f-bdd6e4c0afa6'} May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:03.155258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.156667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:03.158138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:03.158138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-114d715c-a8ba-4ec4-890c-ed7fc3cec18e tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 404 len: 111 microversion: 2.20 time: 0.030632 May 26 18:11:03.158138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 461/899] 10.222.0.121 () {60 vars in 1284 bytes} [Thu May 26 18:11:03 2022] DELETE /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:11:03.163186 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:03.163795 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 909b9763-42b5-4082-986f-bdd6e4c0afa6] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:03.171696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.172142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.172907 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:03.173341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:03.187166 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 HTTP/1.1 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:11:03.188699 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.190367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '909b9763-42b5-4082-986f-bdd6e4c0afa6'} May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:03.191278 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. May 26 18:11:03.192704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:03.194044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 909b9763-42b5-4082-986f-bdd6e4c0afa6 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:03.194044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6e3bcf52-6e8f-4186-a7ce-89bcac3a142b tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6" status: 404 len: 111 microversion: 2.20 time: 0.031290 May 26 18:11:03.194044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 439/900] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:11:03 2022] GET /compute/v2.1/servers/909b9763-42b5-4082-986f-bdd6e4c0afa6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:11:04.485586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.486248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.492623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.493082 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.493847 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.494288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.513524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae HTTP/1.1 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:11:04.515094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.516905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '33849f73-e433-4e48-947b-b1e14b3844ae'} May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:04.517934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.519426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:11:04.520960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:04.520960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-46c256d7-3674-47d6-822a-24fa8441085f tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 404 len: 111 microversion: 2.20 time: 0.036508 May 26 18:11:04.520960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 462/901] 10.222.0.121 () {60 vars in 1284 bytes} [Thu May 26 18:11:04 2022] DELETE /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:11:04.525752 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:04.526412 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] [instance: 33849f73-e433-4e48-947b-b1e14b3844ae] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:04.533074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.533538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.534314 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:04.534748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:04.549919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] HTTP exception thrown: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Request method failure captured: May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae HTTP/1.1 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8AU-yJEA1oarn68NdwX3jpTPRHZpgKDeQkCVzM4QzMAekeH6ivTIBHRBEaJmkY9yZPPBIPlVK8B-THSTfsfn1zLih6Cc3yWB1PnlpJFjHLr_zhcyRfLExDFPX3rOJG1QA8RXu7hCmCW27iYFGrABiN3jzFoEtYvog2jeYf9cLFk26U May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Openstack-Nova-Api-Version: 2.20 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:11:04.551499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/68bd0110e4fd4e6dbef9f65397908292"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_68bd0110e4fd4e6dbef9f65397908292", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 68bd0110e4fd4e6dbef9f65397908292 May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-305795294 May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: fe1c86c411834f1c8d2775a5b2c5f1d1 May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeShelveTestJSON-305795294-project May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.554266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '33849f73-e433-4e48-947b-b1e14b3844ae'} May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:11:04.555739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. May 26 18:11:04.559161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:11:04.561158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] Returning 404 to user: Instance 33849f73-e433-4e48-947b-b1e14b3844ae could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:11:04.561158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-02c65a17-00cf-46fd-a5fd-e4a427e9a512 tempest-AttachVolumeShelveTestJSON-305795294 tempest-AttachVolumeShelveTestJSON-305795294-project] 10.222.0.121 "GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae" status: 404 len: 111 microversion: 2.20 time: 0.031603 May 26 18:11:04.561158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 440/902] 10.222.0.121 () {60 vars in 1281 bytes} [Thu May 26 18:11:04 2022] GET /compute/v2.1/servers/33849f73-e433-4e48-947b-b1e14b3844ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 18:11:15.579884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:15.593954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:15.704299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3cab6b7e-92aa-46cf-a530-fca428fc1dc1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: .version_select at 0x7f4b896cee50>, body: {"keypair": {"name": "tempest-keypair-1839422762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIkM1J3PthH7Bp6bnhk7JXliq/80jSoI4U1QMr7wqiM5+8E+xRwscvEt0qBQQ/39PPoTzCk7E1tV8rOypNQwmXJIC+i1TCZf0CuEYqtMzNR3lvuCw0eW3+pmndEcoWTkw=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:15.720430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-3cab6b7e-92aa-46cf-a530-fca428fc1dc1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:11:15.724846 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-3cab6b7e-92aa-46cf-a530-fca428fc1dc1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for user 7df2a24143654445bcb96df81e960c9d and project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:11:15.851900 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3cab6b7e-92aa-46cf-a530-fca428fc1dc1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277074 May 26 18:11:15.858299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 463/903] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:11:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:18.190121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-631228676", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6294b463-76fc-4cde-9ac4-4bbb39ba02cc"}], "security_groups": [{"name": "tempest-securitygroup--807404741"}], "key_name": "tempest-keypair-1839422762", "user_data": "}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:18.197338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:18.197991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=28 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:18.327482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] validate_networks() for [('6294b463-76fc-4cde-9ac4-4bbb39ba02cc', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:11:18.869912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:11:18.871183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:11:18.871990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:11:18.872482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:11:18.872973 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:11:18.882167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.882708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.883614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:18.884145 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:18.902579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:11:18.907051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for user 7df2a24143654445bcb96df81e960c9d and project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:11:18.919605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:11:18.922039 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:11:19.068708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1fa31595-853d-467f-a17e-6b30d58dcc6b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.878190 May 26 18:11:19.068708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 441/904] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:11:18 2022] POST /compute/v2.1/servers => generated 403 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:11:19.075017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6a67bcc2-0f25-421d-ac3e-d5a06e1d13ac tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:19.075688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6a67bcc2-0f25-421d-ac3e-d5a06e1d13ac tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:19.149917 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6a67bcc2-0f25-421d-ac3e-d5a06e1d13ac tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:19.158321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6a67bcc2-0f25-421d-ac3e-d5a06e1d13ac tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1241 microversion: 2.1 time: 0.087607 May 26 18:11:19.158926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 464/905] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:19 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:20.177913 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-610ee3cc-1fc9-4267-89a4-c7ba40b3a3bd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:20.178690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-610ee3cc-1fc9-4267-89a4-c7ba40b3a3bd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:20.239660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-610ee3cc-1fc9-4267-89a4-c7ba40b3a3bd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:20.248551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-610ee3cc-1fc9-4267-89a4-c7ba40b3a3bd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1241 microversion: 2.1 time: 0.075115 May 26 18:11:20.253124 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 442/906] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:20 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:21.268398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:21.269005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:21.275602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:21.276057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:21.277456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:21.278071 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:21.338918 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:21.346848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e9a8ed81-87f5-4f70-bf93-62f5b97ee1f1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1245 microversion: 2.1 time: 0.082569 May 26 18:11:21.347417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 465/907] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:21 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:22.363975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:22.364586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:22.371721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.372206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.372991 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:22.373438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:22.435097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:22.442538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f702e72a-3ebe-4f05-af56-f13cc818a014 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1237 microversion: 2.1 time: 0.082485 May 26 18:11:22.443131 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 443/908] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:22 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:23.459916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:23.460463 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:23.467354 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.467807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.468580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:23.469022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:23.529005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:23.536404 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-491413a9-ac69-41d1-9f0d-6b118149f572 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1237 microversion: 2.1 time: 0.080754 May 26 18:11:23.536954 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 466/909] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:23 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:24.554163 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:24.554754 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:24.560958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.570593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.570593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:24.570593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:24.628596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:24.635851 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4ccbd686-a83d-4f77-a91c-c1a1453d21a3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1293 microversion: 2.1 time: 0.086431 May 26 18:11:24.646886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 444/910] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:24 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:25.654206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:25.655390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:25.662317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.663049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.663952 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:25.667868 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:25.815908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:25.824557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-afca0015-c24e-448a-aa14-17d3e1141dbd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.176142 May 26 18:11:25.834481 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 467/911] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:25 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:26.623904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-2a8fea69-56c9-4aee-b587-4723a02036a7 req-f25d024f-fc9e-433a-bc3c-f99fb969166b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86aa96be-ceb5-4d4d-8233-5f24483b0d3d", "tag": "0aa3a8e6-218a-4fd1-97cd-833470896c93"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:26.633532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2a8fea69-56c9-4aee-b587-4723a02036a7 req-f25d024f-fc9e-433a-bc3c-f99fb969166b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.633980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2a8fea69-56c9-4aee-b587-4723a02036a7 req-f25d024f-fc9e-433a-bc3c-f99fb969166b service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.647122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-2a8fea69-56c9-4aee-b587-4723a02036a7 req-f25d024f-fc9e-433a-bc3c-f99fb969166b service nova] Creating event network-changed:0aa3a8e6-218a-4fd1-97cd-833470896c93 for instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d on hv-cinder-83607 May 26 18:11:26.656602 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-2a8fea69-56c9-4aee-b587-4723a02036a7 req-f25d024f-fc9e-433a-bc3c-f99fb969166b service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037076 May 26 18:11:26.657466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 445/912] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:26.842808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:26.843621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:26.850067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.850522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.851347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:26.851780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:26.998493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:27.006248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9381ae15-8dfc-4595-9ffc-b9bb2ab6cb10 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.168336 May 26 18:11:27.009018 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 468/913] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:26 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:28.025500 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:28.026687 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:28.033288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.033682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.034457 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:28.035083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:28.196590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:28.204393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2c27fb6f-98a1-4cad-acb0-b085da47bab9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.183775 May 26 18:11:28.205355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 446/914] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:28 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:29.221293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:29.221912 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:29.224259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:29.229096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.230033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.231035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:29.231477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:29.360256 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:29.367804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-57d2c9b7-c8e5-481f-843f-142edb6a2d48 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.150507 May 26 18:11:29.368363 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 469/915] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:29 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:30.385576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:30.386224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:30.388403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:30.389095 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:30.393922 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:30.394402 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:30.395474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:30.395750 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:30.755844 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:30.764243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-103f9910-2f8f-48fc-90a7-bc5ae7f53847 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.382794 May 26 18:11:30.764803 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 447/916] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:30 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:31.781968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:31.782579 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:31.789138 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.789586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:31.790347 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:31.790781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:31.920244 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:31.927824 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3d33d303-dac7-4bbc-853b-c3fd66a19890 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.149714 May 26 18:11:31.928634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 470/917] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:31 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:32.947469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:32.947469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:32.952833 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:32.953291 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:32.954069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:32.954511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:33.098281 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:33.107204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-43e5d9a5-d2a3-4797-bdb6-7c783e5d8248 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.165650 May 26 18:11:33.107933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 448/918] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:32 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:11:33.733292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-835dd490-58f3-4904-a8a0-a6782af784cb req-f0c82b05-9c79-46e9-9266-b319c163602d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86aa96be-ceb5-4d4d-8233-5f24483b0d3d", "name": "network-vif-plugged", "status": "completed", "tag": "0aa3a8e6-218a-4fd1-97cd-833470896c93"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:33.741603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-835dd490-58f3-4904-a8a0-a6782af784cb req-f0c82b05-9c79-46e9-9266-b319c163602d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:33.742057 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-835dd490-58f3-4904-a8a0-a6782af784cb req-f0c82b05-9c79-46e9-9266-b319c163602d service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:33.755638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-835dd490-58f3-4904-a8a0-a6782af784cb req-f0c82b05-9c79-46e9-9266-b319c163602d service nova] Creating event network-vif-plugged:0aa3a8e6-218a-4fd1-97cd-833470896c93 for instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d on hv-cinder-83607 May 26 18:11:33.761471 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-835dd490-58f3-4904-a8a0-a6782af784cb req-f0c82b05-9c79-46e9-9266-b319c163602d service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120566 May 26 18:11:33.762071 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 471/919] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:34.124945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:34.125672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:34.132274 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.132821 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.133701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:34.134205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:34.269660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:34.277966 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2f3f64cd-d670-41d4-9660-8d822923c1ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.157300 May 26 18:11:34.278529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 449/920] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:34 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:35.297820 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:35.298524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:35.305019 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.305473 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:35.306235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:35.306672 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:35.437779 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:35.445232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a576a599-1813-44f9-96a9-7ab21f7985f2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.152136 May 26 18:11:35.445782 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 472/921] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:35 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:36.462478 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:36.463108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:36.470336 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:36.470796 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:36.471566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:36.472000 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:36.602392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:36.609802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6d7e6d8c-baa3-43ac-a166-7a4b0ac393ae tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.151178 May 26 18:11:36.610345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 450/922] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:36 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:37.626265 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:37.626896 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:37.633399 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.633847 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.634604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:37.635075 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:37.762672 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:37.770321 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4adba055-9d74-4326-a0e2-97d7b6416e7e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.147869 May 26 18:11:37.779263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 473/923] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:37 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:38.785984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:38.786595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:38.793870 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.794322 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.795297 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:38.795597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:38.930485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:38.939158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-06348a35-38f1-4d80-8bf8-74e67a5eb4bb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1366 microversion: 2.1 time: 0.157049 May 26 18:11:38.939733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 451/924] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:38 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:39.955801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:39.956440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:39.963092 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.963551 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:39.964317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:39.964753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:40.096913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:11:40.105106 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2b669cfa-7945-426d-abb8-d10d5c16f8e7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1552 microversion: 2.1 time: 0.153009 May 26 18:11:40.105687 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 474/925] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:11:39 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:11:40.121478 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:11:40.121961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:11:40.128485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:40.128943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:40.129715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:40.130179 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:40.209911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-caeec41b-4b47-417d-bc83-548c045ab489 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092482 May 26 18:11:40.210533 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 452/926] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:11:40 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:11:41.185614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-6ac173d4-b172-4ce5-b7cc-25bbaaa32829 req-7f1d0e37-48aa-45e1-95ae-5897ec0ca245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86aa96be-ceb5-4d4d-8233-5f24483b0d3d", "tag": "0aa3a8e6-218a-4fd1-97cd-833470896c93"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:11:41.194221 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-6ac173d4-b172-4ce5-b7cc-25bbaaa32829 req-7f1d0e37-48aa-45e1-95ae-5897ec0ca245 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:11:41.194671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-6ac173d4-b172-4ce5-b7cc-25bbaaa32829 req-7f1d0e37-48aa-45e1-95ae-5897ec0ca245 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:11:41.206204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-6ac173d4-b172-4ce5-b7cc-25bbaaa32829 req-7f1d0e37-48aa-45e1-95ae-5897ec0ca245 service nova] Creating event network-changed:0aa3a8e6-218a-4fd1-97cd-833470896c93 for instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d on hv-cinder-83607 May 26 18:11:41.211390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-6ac173d4-b172-4ce5-b7cc-25bbaaa32829 req-7f1d0e37-48aa-45e1-95ae-5897ec0ca245 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030314 May 26 18:11:41.212001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 475/927] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:12:51.622967 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:51.623770 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=56 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:51.628071 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:51.628600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:51.634600 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.635094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.636431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.636864 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.667405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:12:51.945635 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-388f64d6-55e3-4854-91a2-bcd3f5d5ba62 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "DELETE /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 204 len: 0 microversion: 2.1 time: 0.324301 May 26 18:12:51.946238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 453/928] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:12:51 2022] DELETE /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:12:51.953796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:51.954546 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=58 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:51.958886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:51.959598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:51.966432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.966957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:51.967737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:51.968197 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:52.103760 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:52.111982 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-aaedc420-2d68-4d6a-888b-d3ff15670aa1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1579 microversion: 2.1 time: 0.160199 May 26 18:12:52.112569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 476/929] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:51 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:12:53.129903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:53.130604 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:53.137228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:53.137677 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:53.138449 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:53.138933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:53.363693 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:53.371378 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d1fbb1eb-d429-4eee-9441-1340bf0d87fb tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1579 microversion: 2.1 time: 0.245690 May 26 18:12:53.371955 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 454/930] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:53 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1579 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:54.389367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:54.394086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:54.405070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.405789 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.406788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:54.407283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:54.665627 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:54.676430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-20e580d1-949e-453c-b409-f1caa894de5c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1579 microversion: 2.1 time: 0.291557 May 26 18:12:54.680192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 477/931] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:54 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1579 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:55.052701 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-283f4010-c857-4af8-9c4e-54ef8df2b6d4 req-d374fe5e-dec9-4526-8a95-e7c3af4f8273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3c61ea-ea27-4ef4-a252-9e4893a80974", "name": "network-vif-deleted", "tag": "28bc8818-a564-40ef-b786-1e12f252e269"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:55.062312 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-283f4010-c857-4af8-9c4e-54ef8df2b6d4 req-d374fe5e-dec9-4526-8a95-e7c3af4f8273 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.062901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-283f4010-c857-4af8-9c4e-54ef8df2b6d4 req-d374fe5e-dec9-4526-8a95-e7c3af4f8273 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.075331 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-283f4010-c857-4af8-9c4e-54ef8df2b6d4 req-d374fe5e-dec9-4526-8a95-e7c3af4f8273 service nova] Creating event network-vif-deleted:28bc8818-a564-40ef-b786-1e12f252e269 for instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 on hv-cinder-83607 May 26 18:12:55.083241 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-283f4010-c857-4af8-9c4e-54ef8df2b6d4 req-d374fe5e-dec9-4526-8a95-e7c3af4f8273 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034095 May 26 18:12:55.084254 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 455/932] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:12:55.694003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:55.695268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:55.704397 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.705243 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.706278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.706968 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.748065 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:55.749139 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:55.750602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lazy-loading 'fault' on Instance uuid ba3c61ea-ea27-4ef4-a252-9e4893a80974 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:12:55.812827 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:55.829839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-78ce6987-d788-4b41-b3a7-9a1c1fc22e60 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 200 len: 1233 microversion: 2.1 time: 0.139482 May 26 18:12:55.830384 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 478/933] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:55 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 1233 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:12:56.848585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:56.849957 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:56.857307 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.857845 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.858695 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:56.859228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:56.873706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] HTTP exception thrown: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Request method failure captured: May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 HTTP/1.1 May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8JUSPOpkxr2NmgtbJRsP_qO3mpI2kfgS7-sjGb9xIdSr1p1BTDqx8hkG2QwJKRNKX0tlA4YIeEPHFm-jifoP81Xdzj0ZlxLq7aJibU0UgNCPpeSQDzQj2ZpW9GHoFNx6xeokmMrKblJZvD2QbOio2cebeYtroDAvdLdqOfuFopx4vo May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:12:56.875542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7daf2a694ab840949d8cf403c2573bda", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestVolumeBootPattern-1256171076 May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestVolumeBootPattern-1256171076-project May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: e7e74d9bfa6144ae8ad7e3156fb42e6e May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestVolumeBootPattern-1256171076-project May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:12:56.877257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': 'ba3c61ea-ea27-4ef4-a252-9e4893a80974'} May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:12:56.878130 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:12:56.879707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:12:56.881719 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Returning 404 to user: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:12:56.882860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-24a786b6-d584-4fe0-be17-08c3b98383ca tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 404 len: 111 microversion: 2.1 time: 0.038918 May 26 18:12:56.887911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 456/934] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:56 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:12:56.981967 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1981649494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303959824", "security_groups": [{"name": "tempest-secgroup-smoke-142513058"}], "block_device_mapping_v2": [{"uuid": "cdaacd4e-3d02-4b25-8a77-ce20c6fc32a0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8063d2c8-f54f-4352-9b7a-ae641c155ce0"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:12:57.105526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] validate_networks() for [('8063d2c8-f54f-4352-9b7a-ae641c155ce0', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:12:57.555263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:12:57.555691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:12:57.556169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:12:57.556584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:12:57.557232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:12:57.567379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.573136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.573136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:12:57.573136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:12:57.590086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:12:57.594769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for user e7e74d9bfa6144ae8ad7e3156fb42e6e and project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:12:57.660829 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:12:57.666480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdaacd4e-3d02-4b25-8a77-ce20c6fc32a0',volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:12:58.097519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [5c13c955-5d24-45eb-ba2d-b77127b34e8e] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:12:59.105600 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [5c13c955-5d24-45eb-ba2d-b77127b34e8e] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 42056. May 26 18:12:59.111525 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-84595ad6-ed53-4575-8a51-f95d432c35b3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.134314 May 26 18:12:59.117804 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 479/935] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:12:56 2022] POST /compute/v2.1/servers => generated 407 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:12:59.123735 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-95ccf102-d643-4d56-a9c8-bcb59ca2fa44 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:12:59.130335 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-95ccf102-d643-4d56-a9c8-bcb59ca2fa44 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:12:59.188739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-95ccf102-d643-4d56-a9c8-bcb59ca2fa44 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:12:59.196111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-95ccf102-d643-4d56-a9c8-bcb59ca2fa44 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1097 microversion: 2.1 time: 0.077550 May 26 18:12:59.196893 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 457/936] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:12:59 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1097 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:00.214331 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d74dd5b2-1769-40ba-849c-8f37a787385e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:00.216447 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d74dd5b2-1769-40ba-849c-8f37a787385e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:00.277495 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d74dd5b2-1769-40ba-849c-8f37a787385e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:00.284649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d74dd5b2-1769-40ba-849c-8f37a787385e tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1097 microversion: 2.1 time: 0.075466 May 26 18:13:00.285232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 480/937] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:00 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1097 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:01.302162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a3595bd8-28c3-4bcb-853a-5aad88dff036 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:01.302162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a3595bd8-28c3-4bcb-853a-5aad88dff036 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:01.368642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a3595bd8-28c3-4bcb-853a-5aad88dff036 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:01.376379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a3595bd8-28c3-4bcb-853a-5aad88dff036 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1097 microversion: 2.1 time: 0.078727 May 26 18:13:01.377649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 458/938] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:01 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1097 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:02.396206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-50b58e7b-9f26-443b-af68-0cffbb4d2865 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:02.396897 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-50b58e7b-9f26-443b-af68-0cffbb4d2865 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:02.691591 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-50b58e7b-9f26-443b-af68-0cffbb4d2865 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:02.700345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-50b58e7b-9f26-443b-af68-0cffbb4d2865 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1097 microversion: 2.1 time: 0.308798 May 26 18:13:02.701157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 481/939] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:02 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1097 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:03.724875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:03.725482 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:03.733134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.733745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:03.734575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:03.735060 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:03.798412 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:03.806257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6302efdc-3663-4e1b-886a-a66af61dfbed tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1147 microversion: 2.1 time: 0.085351 May 26 18:13:03.807316 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 459/940] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:03 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:04.827287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:04.827903 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:04.841033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.841815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.843003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:04.843651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:04.915576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:04.924537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-17531106-f8b4-4e9a-89e5-ba0d420811a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1195 microversion: 2.1 time: 0.101114 May 26 18:13:04.925735 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 482/941] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:04 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1195 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:05.200834 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1fdbb42c-d07c-4ec8-b287-0ac24c0a4fcf tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Action: 'create', calling method: .version_select at 0x7f4b897220d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1809947172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJhmSQiWqlmVx038u7DQLr5fS6ofsq2At5slLN/6oX89wTr1eRVjLQ/jjYyBdbQgugmeZIUEHe0dISoW63v9BrEe3grxjaNatb85Sb+p1W/zG2oVUVhvFZ1xaQJ/uPNhg=="}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:05.215340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-1fdbb42c-d07c-4ec8-b287-0ac24c0a4fcf tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Getting quotas for project a50fbd483e2e4d8886ae5d6341af7dcb. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:05.219841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-1fdbb42c-d07c-4ec8-b287-0ac24c0a4fcf tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Getting quotas for user cdc1042ea3b54768ab87e1f66e74ec1c and project a50fbd483e2e4d8886ae5d6341af7dcb. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:05.330389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1fdbb42c-d07c-4ec8-b287-0ac24c0a4fcf tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.312545 May 26 18:13:05.334754 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 460/942] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:13:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:05.943344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:05.943961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:05.951002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.951462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:05.952468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:05.953101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:06.021320 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:06.030337 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7914a665-3da5-44a7-92cd-178e349d47d1 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1213 microversion: 2.1 time: 0.090715 May 26 18:13:06.030943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 483/943] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:05 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:07.049249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:07.051284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:07.063563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.064291 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.066059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.066678 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.292895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:07.303745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9abbda0a-39fb-403e-b706-89f97a4868c0 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.259594 May 26 18:13:07.306219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 461/944] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:07 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:07.411080 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-563093a0-2b7c-48ed-8434-0928f5af8d97 req-291516c8-b9f1-4ca4-8463-d515bc530bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db37847-310c-4822-848c-d10ff3623677", "tag": "f0780c28-b166-4478-93b7-810e8d90b249"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:07.426397 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-563093a0-2b7c-48ed-8434-0928f5af8d97 req-291516c8-b9f1-4ca4-8463-d515bc530bb7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.426872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-563093a0-2b7c-48ed-8434-0928f5af8d97 req-291516c8-b9f1-4ca4-8463-d515bc530bb7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.450557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-563093a0-2b7c-48ed-8434-0928f5af8d97 req-291516c8-b9f1-4ca4-8463-d515bc530bb7 service nova] Creating event network-changed:f0780c28-b166-4478-93b7-810e8d90b249 for instance 8db37847-310c-4822-848c-d10ff3623677 on hv-cinder-83607 May 26 18:13:07.457305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-563093a0-2b7c-48ed-8434-0928f5af8d97 req-291516c8-b9f1-4ca4-8463-d515bc530bb7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050115 May 26 18:13:07.458450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 484/945] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:13:07.828410 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:07.829306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:07.837643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.839200 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.840518 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:07.842367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:07.879734 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-985ceacc-4277-4e4b-ad38-b928952fb1b5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/ips" status: 200 len: 145 microversion: 2.1 time: 0.056002 May 26 18:13:07.881657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 462/946] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:13:07 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:08.321296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:08.335410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:08.336204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:08.343541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:08.344002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:08.344785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:08.345219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:08.560468 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:08.569086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-06c54c57-3533-4f52-8005-ee371fd59a2c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.248599 May 26 18:13:08.570199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 485/947] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:08 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:09.588180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:09.588794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:09.596141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:09.596917 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:09.597926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:09.598382 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:09.752767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:09.761895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dc1c9ef2-8482-4388-ac36-283a790ce624 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.178113 May 26 18:13:09.762684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 463/948] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:09 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:10.778863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:10.779486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:10.786073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.786664 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.787768 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:10.788296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:10.928317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:10.936621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fead9a17-e407-4ca0-a08a-90985af93db4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.161774 May 26 18:13:10.937417 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 486/949] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:10 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:11.024727 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93ae4c22-975b-4415-9bf8-e33333830882"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:11.026629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:11.033342 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.033700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.034542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.034972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.704659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bb0801be-80c6-49b9-b92f-080c0462153a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683565 May 26 18:13:11.705337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 464/950] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:13:11 2022] POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:11.953736 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:11.954349 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:11.960840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.961235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:11.962015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:11.962441 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:12.096037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:12.100819 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7f4e0887-0ccf-4a06-bf7b-5e5c33fd7b7d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.150983 May 26 18:13:12.101419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 487/951] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:11 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:13.119356 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:13.122767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:13.127798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:13.128252 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.129024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:13.129465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:13.268142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:13.275554 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-abe354df-7a12-40ce-b512-0c476b264cde tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.160458 May 26 18:13:13.276113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 465/952] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:13 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:14.294287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:14.295042 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:14.297035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=10 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:14.303261 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.318695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.318695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:14.318695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:14.441339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:14.449434 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b134c081-3ba5-4d9f-8394-1918604ec05c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.159745 May 26 18:13:14.450024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 488/953] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:14 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:15.468338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:15.469667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:15.472405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:15.477358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:15.477863 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:15.478650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:15.479125 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:15.613925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:15.623730 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4b6a1f78-2d7c-428d-af41-a0e314910c30 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.159384 May 26 18:13:15.624467 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 466/954] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:15 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:16.640979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:16.641509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:16.648060 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:16.648507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:16.649265 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:16.649700 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:16.786029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:16.793462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3ec9ed4e-ca77-4bee-b056-6a706ccf8623 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.156526 May 26 18:13:16.794960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 489/955] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:16 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:17.811606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:17.812161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:17.819625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:17.820101 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.821047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:17.821648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:17.956638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:17.966107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f350fff1-6a29-49c0-aec7-e077b49b08b4 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.157888 May 26 18:13:17.967230 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 467/956] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:17 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:18.983801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:18.984454 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:18.990837 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.991299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:18.992217 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:18.992708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:19.145777 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:19.153221 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6da30daf-8f42-43c5-8e94-62bb71f3e88f tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.173676 May 26 18:13:19.154850 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 490/957] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:18 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:20.169704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:20.170933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:20.177269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.177715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.178481 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.178959 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.238259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-b62f4003-997b-4582-9330-9cd7ed4e523b req-2bdc0b15-10a1-44fa-8323-861ca4a160d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db37847-310c-4822-848c-d10ff3623677", "name": "network-vif-plugged", "status": "completed", "tag": "f0780c28-b166-4478-93b7-810e8d90b249"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:20.249755 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b62f4003-997b-4582-9330-9cd7ed4e523b req-2bdc0b15-10a1-44fa-8323-861ca4a160d9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.250203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b62f4003-997b-4582-9330-9cd7ed4e523b req-2bdc0b15-10a1-44fa-8323-861ca4a160d9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.263408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-b62f4003-997b-4582-9330-9cd7ed4e523b req-2bdc0b15-10a1-44fa-8323-861ca4a160d9 service nova] Creating event network-vif-plugged:f0780c28-b166-4478-93b7-810e8d90b249 for instance 8db37847-310c-4822-848c-d10ff3623677 on hv-cinder-83607 May 26 18:13:20.269759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-b62f4003-997b-4582-9330-9cd7ed4e523b req-2bdc0b15-10a1-44fa-8323-861ca4a160d9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035967 May 26 18:13:20.270359 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 491/958] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:13:20.319323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-36ba3e6f-78cb-483e-a7da-69ade5c3292a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:20.321122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:20.325879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-36ba3e6f-78cb-483e-a7da-69ade5c3292a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.331263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-36ba3e6f-78cb-483e-a7da-69ade5c3292a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.331572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-68e674df-8f07-4324-8cc7-74a4179be9a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.164301 May 26 18:13:20.331572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 468/959] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:20 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:20.393237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-36ba3e6f-78cb-483e-a7da-69ade5c3292a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Going to try to stop instance {{(pid=130099) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:13:20.611556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-36ba3e6f-78cb-483e-a7da-69ade5c3292a tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.296172 May 26 18:13:20.612083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 492/960] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:13:20 2022] POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:13:20.620455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:20.621079 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:20.627963 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.628424 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.629198 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:20.629641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:20.775455 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:20.783903 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-719221b2-be1e-4bf7-bf2b-81f03d136094 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.167297 May 26 18:13:20.784484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 469/961] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:20 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:21.348606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:21.349304 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:21.355593 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.356042 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.356798 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.357234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.490584 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:21.498513 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7d8059ee-8cb9-453f-8acb-e3ba59622225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1268 microversion: 2.1 time: 0.154438 May 26 18:13:21.499104 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 493/962] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:21 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:21.801857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:21.802465 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:21.805116 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:21.809769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.810217 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.811633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:21.812068 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:21.814629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:21.940543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:21.948352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-29d4a58e-54bb-4e4d-93a1-b1bcad023543 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.150348 May 26 18:13:21.948964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 470/963] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:21 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:22.515899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:22.516562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:22.523193 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.527093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.527093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.527093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.527551 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:22.660714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:22.668461 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-760b5b03-2c70-4249-bfd0-f8e4c2e2f2df tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1455 microversion: 2.1 time: 0.157160 May 26 18:13:22.669023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 494/964] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:22 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:22.685364 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:22.686009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:22.692938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.693414 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.694210 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.694649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.837038 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:22.844777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-088c35cf-cec7-4c6f-a000-afd134be6e10 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1455 microversion: 2.1 time: 0.163898 May 26 18:13:22.849085 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 471/965] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:22 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:22.965754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:22.966300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:22.972993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.973440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:22.974196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:22.974629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:23.191729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:23.199693 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-af800941-cb3e-425b-82ec-bf5c812f3b14 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.237976 May 26 18:13:23.200262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 495/966] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:22 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:24.217681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:24.218747 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:24.225542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.225997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.226785 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.241523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.459478 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:24.468015 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ecce26d2-c555-498d-b710-d9182b73512c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.253819 May 26 18:13:24.468591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 472/967] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:24 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:24.968660 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-157d6f7b-e80c-4e7f-aaac-c5a9c16a78ca req-5948d83c-ca37-4851-9dbe-13ed2ae20905 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db37847-310c-4822-848c-d10ff3623677", "tag": "f0780c28-b166-4478-93b7-810e8d90b249"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:24.972129 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:24.977547 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-157d6f7b-e80c-4e7f-aaac-c5a9c16a78ca req-5948d83c-ca37-4851-9dbe-13ed2ae20905 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:24.977996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-157d6f7b-e80c-4e7f-aaac-c5a9c16a78ca req-5948d83c-ca37-4851-9dbe-13ed2ae20905 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:24.989671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-157d6f7b-e80c-4e7f-aaac-c5a9c16a78ca req-5948d83c-ca37-4851-9dbe-13ed2ae20905 service nova] Creating event network-changed:f0780c28-b166-4478-93b7-810e8d90b249 for instance 8db37847-310c-4822-848c-d10ff3623677 on hv-cinder-83607 May 26 18:13:24.994632 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-157d6f7b-e80c-4e7f-aaac-c5a9c16a78ca req-5948d83c-ca37-4851-9dbe-13ed2ae20905 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090293 May 26 18:13:24.995501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 496/968] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:25.488087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:25.492311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:25.500343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:25.501078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:25.501873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:25.502599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:25.650119 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:25.661641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4c60d89c-9298-49f1-be6e-b8f6ef7e6b1c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.180071 May 26 18:13:25.670317 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 473/969] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:25 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:26.680522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:26.681164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:26.688067 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.688521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:26.689292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:26.689758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:26.821852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:26.829925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3064d834-e7ad-4a7d-b9f7-17eab43ee383 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.154443 May 26 18:13:26.830502 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 497/970] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:26 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:27.847218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:27.847823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:27.854262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:27.854709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:27.855494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:27.863225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:27.983037 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:27.992014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1c318c46-88a9-4570-8c23-2eb84f440a66 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.148906 May 26 18:13:27.992578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 474/971] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:27 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:29.009985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:29.010651 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:29.017788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:29.018234 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:29.019041 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:29.019535 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:29.151560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:29.159595 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-175ac10a-791d-4ec3-9002-3de38b0596f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.153781 May 26 18:13:29.160155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 498/972] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:29 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:30.178643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:30.178643 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:30.184777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:30.185227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:30.185994 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:30.186473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:30.187083 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-893200433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1809947172", "security_groups": [{"name": "tempest-secgroup-smoke-725606388"}], "networks": [{"uuid": "c98fe90f-6f31-4a13-bac0-dee7aaf258e9"}], "block_device_mapping_v2": [{"uuid": "7b9d642c-4b89-47cc-a3a4-6e356ade0efd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:30.342355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] validate_networks() for [('c98fe90f-6f31-4a13-bac0-dee7aaf258e9', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:13:30.381829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:30.389779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-00026cb3-a316-4428-975c-bc6f387d9527 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.217130 May 26 18:13:30.400070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 475/973] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:30 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:30.731307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:13:30.731728 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:13:30.732199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:13:30.732605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:13:30.733015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:13:30.742605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:30.743191 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:30.743985 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:30.744421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:30.761249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Getting quotas for project a50fbd483e2e4d8886ae5d6341af7dcb. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:13:30.765166 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Getting quotas for user cdc1042ea3b54768ab87e1f66e74ec1c and project a50fbd483e2e4d8886ae5d6341af7dcb. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:13:30.822899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:13:30.824961 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b9d642c-4b89-47cc-a3a4-6e356ade0efd',volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:13:31.209802 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8b2f3deb-9e1b-4174-94be-4307ffd89e31 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.026489 May 26 18:13:31.210753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 499/974] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:13:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) May 26 18:13:31.221111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-15aa054d-dc58-437c-8400-ca8913ab9114 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:31.221731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15aa054d-dc58-437c-8400-ca8913ab9114 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:31.275368 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-15aa054d-dc58-437c-8400-ca8913ab9114 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:31.282617 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-15aa054d-dc58-437c-8400-ca8913ab9114 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1091 microversion: 2.1 time: 0.065476 May 26 18:13:31.283432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 476/975] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:31 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1091 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:31.408249 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:31.408886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:31.416169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:31.421853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:31.421853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:31.421853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:31.549714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:31.557920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d3a16864-1578-46c7-8094-9e82cd1acc6e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.154295 May 26 18:13:31.558493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 500/976] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:31 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:32.300287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:32.300951 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:32.310788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:32.311277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:32.312069 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:32.312538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:32.377288 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:32.384664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d366de0d-a626-40b4-840a-bd4b58960ce1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1141 microversion: 2.1 time: 0.088820 May 26 18:13:32.385236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 477/977] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:32 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1141 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:32.575403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:32.575957 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:32.582965 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:32.583420 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:32.584194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:32.584628 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:32.721215 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:32.729299 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d4ac6bc8-0a97-4130-9c74-92379c581431 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.157809 May 26 18:13:32.729876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 501/978] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:32 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:33.401485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:33.402107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:33.409358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:33.409999 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:33.410581 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:33.411137 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:33.474472 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:33.482965 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-473dac60-8d25-4cfe-8f13-c3611495fa9b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1197 microversion: 2.1 time: 0.084511 May 26 18:13:33.483261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 478/979] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:33 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:33.746103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:33.747410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:33.754391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:33.754863 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:33.755640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:33.756295 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:34.130372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:34.137158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a7d13489-7b48-4542-b9a0-35b940034743 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.395005 May 26 18:13:34.137723 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 502/980] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:33 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:34.500093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:34.500715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:34.509167 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:34.509904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:34.511489 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:34.511942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:34.649972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:34.657964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-79c8f678-05f6-450f-b1bb-af9cb8cec0fe tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1274 microversion: 2.1 time: 0.161567 May 26 18:13:34.658629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 479/981] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:34 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:35.155367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:35.155981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:35.163793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.164241 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.165263 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.165673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.183403 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-b16d97ee-546c-4919-85ee-be37e19816c8 req-966a43ff-e8a0-41b6-ad67-9d0257123510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:35.196183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-b16d97ee-546c-4919-85ee-be37e19816c8 req-966a43ff-e8a0-41b6-ad67-9d0257123510 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.196633 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-b16d97ee-546c-4919-85ee-be37e19816c8 req-966a43ff-e8a0-41b6-ad67-9d0257123510 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.211763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-b16d97ee-546c-4919-85ee-be37e19816c8 req-966a43ff-e8a0-41b6-ad67-9d0257123510 service nova] Creating event network-changed:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:13:35.217873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-b16d97ee-546c-4919-85ee-be37e19816c8 req-966a43ff-e8a0-41b6-ad67-9d0257123510 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038064 May 26 18:13:35.219365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 480/982] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:35.359569 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:35.368899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0d55837a-13df-4308-9c59-44bc46953edd tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1726 microversion: 2.1 time: 0.217392 May 26 18:13:35.369554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 503/983] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:35 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1726 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:35.677866 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:35.678577 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:35.685161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.685618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.686397 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:35.686861 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:35.819877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:35.827673 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-22e0c302-af43-435a-8316-fe931f70b94b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.155550 May 26 18:13:35.828286 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 481/984] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:35 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:36.387257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:36.388492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:36.398100 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.398571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.399399 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.399852 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.531096 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:36.539744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-111a9e70-7e4b-4130-bca9-d74c1e192601 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1703 microversion: 2.1 time: 0.156370 May 26 18:13:36.540310 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 504/985] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:36 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1703 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:36.557259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-921a5c5b-a118-48b9-93cd-2da8a5f948c5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:36.563339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-921a5c5b-a118-48b9-93cd-2da8a5f948c5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.563986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-921a5c5b-a118-48b9-93cd-2da8a5f948c5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.623041 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-921a5c5b-a118-48b9-93cd-2da8a5f948c5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Going to try to start instance {{(pid=130100) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:13:36.789364 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-921a5c5b-a118-48b9-93cd-2da8a5f948c5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.236605 May 26 18:13:36.790033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 482/986] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:13:36 2022] POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:13:36.797964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:36.798663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:36.804929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.806256 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.806440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.806856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.846423 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:36.847104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:36.853708 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.854161 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.854971 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:36.855405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:36.996121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:37.005997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-8803fa39-585d-4e48-864e-eb74b5992492 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1712 microversion: 2.1 time: 0.211744 May 26 18:13:37.006879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 505/987] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:36 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1712 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:37.030751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:37.039549 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-443f1552-de75-41bc-a8c1-ab1f657ff70e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.198110 May 26 18:13:37.040051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 483/988] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:36 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:38.023567 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:38.024196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:38.030742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:38.031305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.032081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:38.033024 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.056812 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:38.057427 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:38.064285 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:38.064859 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.065652 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:38.066098 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:38.226323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:38.234674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-1c933541-ebef-4838-81f4-2f3b8744f9da tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1712 microversion: 2.1 time: 0.214898 May 26 18:13:38.244533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 506/989] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:38 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1712 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:38.252962 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:38.261373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f5f93193-f04c-4cb5-bef6-3d7ceb87c9f0 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.208623 May 26 18:13:38.261987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 484/990] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:38 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:39.252781 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:39.253390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:39.259979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.260435 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.261385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.261827 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.279739 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:39.280470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:39.287629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.288080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.288839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:39.289271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:39.472490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:39.480343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:39.480757 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-980806c6-a1dd-4d28-b86e-a0dab3cab441 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1716 microversion: 2.1 time: 0.232582 May 26 18:13:39.481342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 507/991] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:39 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1716 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:39.489789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bd40f959-bf93-45e9-bbfc-33270f1de462 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.213469 May 26 18:13:39.492470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 485/992] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:39 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:13:40.507750 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:40.508395 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:40.514834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:40.515301 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:40.516064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:40.516505 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:40.649734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:40.657306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-be6fff6a-5493-4a59-a477-bf238e5704c4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.153357 May 26 18:13:40.658380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 508/993] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:40 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:41.676610 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:41.690045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:41.690045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:41.690045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:41.690045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:41.690045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:41.690551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:41.821706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:41.829207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ececb282-f338-4393-9168-57de8fcd5f0b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.158051 May 26 18:13:41.830627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 486/994] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:41 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:42.846174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:42.846780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:42.848768 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:42.849427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:42.854708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:42.855192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:42.855963 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:42.856400 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:42.985485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:42.993081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9b43b09d-12f6-4b69-8270-7d8763aab93b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.151379 May 26 18:13:42.993653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 509/995] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:42 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:44.010930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:44.011545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:44.019091 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:44.019552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:44.020327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:44.020769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:44.035824 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:44.161073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:44.168725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-75a36215-336d-4253-820b-dffb6cf4e2f7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.161638 May 26 18:13:44.169294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 487/996] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:44 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:45.186678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:45.187361 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:45.193920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:45.194426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:45.195295 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:45.195784 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:45.326936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:45.336035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-42315933-6a5e-4e4c-b02e-86bd80e11ec8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.153255 May 26 18:13:45.336619 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 510/997] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:45 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:46.352689 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:46.353306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:46.359902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:46.360355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:46.361700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:46.362140 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:46.500914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:46.508501 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-08a69e2b-def4-4233-a00d-c2bd4158ccfc tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.159760 May 26 18:13:46.509059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 488/998] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:46 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:47.525808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:47.526408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:47.532922 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:47.533376 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:47.534911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:47.535292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:47.670890 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:47.679208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-33cd8e71-96c6-4e51-a8eb-48db0bf965c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.157244 May 26 18:13:47.679778 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 511/999] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:47 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:48.472923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5282219f-78ea-4f96-a1f6-b6ec44b9b3c3 req-036efd6e-7547-4375-bc3c-bfaf20364670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "name": "network-vif-plugged", "status": "completed", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:48.481791 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5282219f-78ea-4f96-a1f6-b6ec44b9b3c3 req-036efd6e-7547-4375-bc3c-bfaf20364670 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.482247 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5282219f-78ea-4f96-a1f6-b6ec44b9b3c3 req-036efd6e-7547-4375-bc3c-bfaf20364670 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.494593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5282219f-78ea-4f96-a1f6-b6ec44b9b3c3 req-036efd6e-7547-4375-bc3c-bfaf20364670 service nova] Creating event network-vif-plugged:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:13:48.499649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5282219f-78ea-4f96-a1f6-b6ec44b9b3c3 req-036efd6e-7547-4375-bc3c-bfaf20364670 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 May 26 18:13:48.504017 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 489/1000] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:13:48.697450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:48.698157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:48.704519 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.704951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.705722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:48.706169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:48.710298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:48.848992 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:48.856644 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-908e5208-1ea6-49d2-b28a-5789d742a4c9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.163141 May 26 18:13:48.857216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 512/1001] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:48 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:49.875012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:49.875710 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:49.881990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:49.887271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:49.887271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:49.887271 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:50.014808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:50.022450 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8bd14de1-acac-4705-a637-fa04226cd141 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1262 microversion: 2.1 time: 0.152121 May 26 18:13:50.023066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 490/1002] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:49 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:51.039467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:51.040064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:51.046539 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.047033 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.047820 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.048259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.184737 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:51.192797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-45906e4d-d4c8-4c1a-85be-1a5359ed15ac tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1446 microversion: 2.1 time: 0.157850 May 26 18:13:51.193361 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 513/1003] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:51 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:51.209559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:13:51.210300 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:13:51.216676 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.217188 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.218001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:51.218439 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:51.362061 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:13:51.370363 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b2742582-af90-4bf1-bc2f-a96d2c2747be tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1446 microversion: 2.1 time: 0.165246 May 26 18:13:51.371046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 491/1004] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:13:51 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:13:53.469206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-f8c06f34-a407-45d9-a376-cb30e0f6ad6b req-9f081fad-e6e7-4457-a41b-e0b9f5c1e095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:13:53.477679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f8c06f34-a407-45d9-a376-cb30e0f6ad6b req-9f081fad-e6e7-4457-a41b-e0b9f5c1e095 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:13:53.478126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-f8c06f34-a407-45d9-a376-cb30e0f6ad6b req-9f081fad-e6e7-4457-a41b-e0b9f5c1e095 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:13:53.490371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-f8c06f34-a407-45d9-a376-cb30e0f6ad6b req-9f081fad-e6e7-4457-a41b-e0b9f5c1e095 service nova] Creating event network-changed:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:13:53.495507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-f8c06f34-a407-45d9-a376-cb30e0f6ad6b req-9f081fad-e6e7-4457-a41b-e0b9f5c1e095 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030111 May 26 18:13:53.496100 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 514/1005] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:14:37.913742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:37.914366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:37.916584 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=45 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:37.917398 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=23 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:37.922974 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:37.923504 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:37.924310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:37.924754 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:38.007175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lazy-loading 'services' on Instance uuid 86aa96be-ceb5-4d4d-8233-5f24483b0d3d {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:14:38.218341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-78534670-364d-4234-addb-877682fe8796 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments/93ae4c22-975b-4415-9bf8-e33333830882" status: 202 len: 0 microversion: 2.1 time: 0.308230 May 26 18:14:38.218969 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 492/1006] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:14:37 2022] DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments/93ae4c22-975b-4415-9bf8-e33333830882 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:14:40.382785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.383545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=13 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:40.387663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5e46dddb-e190-4593-8f27-57a207e2abbb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:40.393814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e46dddb-e190-4593-8f27-57a207e2abbb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:40.396431 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e46dddb-e190-4593-8f27-57a207e2abbb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:40.416631 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5e46dddb-e190-4593-8f27-57a207e2abbb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Going to try to stop instance {{(pid=130099) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 18:14:40.622698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5e46dddb-e190-4593-8f27-57a207e2abbb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.241510 May 26 18:14:40.623361 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 515/1007] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:14:40 2022] POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:14:40.633102 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:40.633806 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:40.639955 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:40.643984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:40.643984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:40.643984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:40.778206 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:40.786528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-66af26ae-31c4-470d-8333-53dd31aedacc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.158623 May 26 18:14:40.787142 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 493/1008] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:40 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:41.804671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:41.805357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:41.811811 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:41.812262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:41.813017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:41.813449 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:42.016739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:42.025003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-117feba5-e797-454a-8938-f3fc76da9a99 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.225117 May 26 18:14:42.025566 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 516/1009] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:41 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:43.041440 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:43.042051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:43.048646 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:43.049100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:43.049866 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:43.050925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:43.181048 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:43.188421 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-586b47ff-d7c7-4048-8e7c-3a212b3a37cc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.150831 May 26 18:14:43.188986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 494/1010] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:43 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:44.205507 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:44.206119 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:44.213230 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:44.213681 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:44.214456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:44.214924 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:44.340891 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:44.348392 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a18f3ab7-742e-40b7-894f-35d2d3d86f43 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.146816 May 26 18:14:44.348955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 517/1011] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:44 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:45.365698 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:45.366337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:45.372777 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:45.373226 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:45.375852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:45.375852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:45.555221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:45.563097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-58297bb3-ddeb-4d09-b612-7db53d11d1db tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.201455 May 26 18:14:45.563657 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 495/1012] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:45 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:46.580926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:46.581528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:46.588832 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:46.589300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:46.590068 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:46.590510 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:46.736246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:46.744317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-615b35e0-03bd-4187-a0d0-477571d2f9a7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.167368 May 26 18:14:46.744883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 518/1013] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:46 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:47.761933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:47.762523 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:47.769043 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:47.769669 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:47.770996 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:47.771438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:47.898302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:47.905707 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c22da9f3-3d5d-4839-85f8-822ee3d1782b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.147647 May 26 18:14:47.906264 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 496/1014] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:47 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:48.922620 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:48.923239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:48.929832 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:48.930279 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:48.931336 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:48.931774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:49.066231 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:49.073857 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7903ee0d-4fb3-426e-9cda-936558a70f89 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.155085 May 26 18:14:49.074422 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 519/1015] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:48 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:50.093059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:50.093865 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:50.101381 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:50.101838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:50.102621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:50.103086 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:50.234112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:50.242437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-70aa4b27-8fb1-4b86-94bf-8643e4643a2e tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.153506 May 26 18:14:50.243036 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 497/1016] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:50 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:51.260038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:51.260649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:51.267155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.267606 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:51.268372 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:51.268805 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:51.398066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:51.405668 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0c9120d3-3d2c-45ae-bf95-80b9b81970f5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.149431 May 26 18:14:51.406316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 520/1017] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:51 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:52.423769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:52.424358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:52.431794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:52.432239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:52.433044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:52.433474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:52.564315 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:52.572068 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-453a44c7-4a64-4a79-abc8-a72c02c2621d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.152228 May 26 18:14:52.574935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 498/1018] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:52 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:53.589362 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:53.589919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:53.595941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:53.596394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:53.597159 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:53.597598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:53.726410 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:53.733840 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-cf77a8ea-05ad-4cb9-a5fc-776b8ba16855 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.148772 May 26 18:14:53.734401 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 521/1019] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:53 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:54.751494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:54.752074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:54.759236 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:54.759685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:54.760451 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:54.760885 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:54.892073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:54.899650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c7d850b8-c9c7-48f9-9024-97d932f0a1e2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.152090 May 26 18:14:54.900216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 499/1020] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:54 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:55.917026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:55.917660 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:55.924060 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:55.924508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:55.925268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:55.925701 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:56.057287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:56.064894 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-99fbcab3-838a-41db-b86d-f85644c69281 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1680 microversion: 2.1 time: 0.151810 May 26 18:14:56.065451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 522/1021] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:55 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:57.081489 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:57.082101 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:57.089294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.089745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.090509 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.090982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.221867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:57.229355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8a2ab12a-59e8-4f79-9eb2-31d811a035ba tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1657 microversion: 2.1 time: 0.151803 May 26 18:14:57.229919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 500/1022] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:57 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:57.245754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4f23e781-033f-4f09-8307-f999d85ce98b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:14:57.252189 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f23e781-033f-4f09-8307-f999d85ce98b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.252636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f23e781-033f-4f09-8307-f999d85ce98b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.274498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4f23e781-033f-4f09-8307-f999d85ce98b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Going to try to start instance {{(pid=130099) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 18:14:57.473645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4f23e781-033f-4f09-8307-f999d85ce98b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action" status: 202 len: 0 microversion: 2.1 time: 0.231224 May 26 18:14:57.474248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 523/1023] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:14:57 2022] POST /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:14:57.482745 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:57.483390 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:57.490237 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.490690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.491491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:57.491932 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:57.626169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:57.633876 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-15e4de97-b5c0-4b0d-ab96-82c92efe98b6 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1666 microversion: 2.1 time: 0.155199 May 26 18:14:57.634771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 501/1024] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:57 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1666 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:58.653077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:58.653776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:58.660157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:58.660789 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:58.661470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:58.661905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:58.795044 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:58.803206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3fbc16ac-a449-42dd-88b6-07eb75b746e1 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1666 microversion: 2.1 time: 0.155038 May 26 18:14:58.803777 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 524/1025] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:58 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:14:59.821316 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:14:59.821928 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:14:59.828100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.828559 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.829321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:14:59.829761 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:14:59.964585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:14:59.972042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0760569a-36eb-4879-93de-d8b72702cd39 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1670 microversion: 2.1 time: 0.155197 May 26 18:14:59.972605 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 502/1026] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:14:59 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:07.997790 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:15:07.998488 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:15:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:15:27.350871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-187383978", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-303959824", "security_groups": [{"name": "tempest-secgroup-smoke-142513058"}], "block_device_mapping_v2": [{"uuid": "3628e577-7864-4093-a462-84db6c612280", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8063d2c8-f54f-4352-9b7a-ae641c155ce0"}]}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:27.359076 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=20 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:27.359799 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:27.464233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] validate_networks() for [('8063d2c8-f54f-4352-9b7a-ae641c155ce0', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:15:27.868884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:15:27.869334 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:15:27.869814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:15:27.870225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:15:27.870639 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:15:27.879429 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:27.879879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:27.880678 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:27.881120 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:27.898022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:15:27.902073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Getting quotas for user e7e74d9bfa6144ae8ad7e3156fb42e6e and project 7daf2a694ab840949d8cf403c2573bda. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:15:27.958941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:15:27.961009 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3628e577-7864-4093-a462-84db6c612280',volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:15:28.345604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9623f456-ab83-443b-a68e-7221dc7be4d8 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.998630 May 26 18:15:28.346251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 525/1027] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:15:27 2022] POST /compute/v2.1/servers => generated 407 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:15:28.357100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-973f6e83-34dc-4e7f-b56c-c3bcb64527f9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:28.357828 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-973f6e83-34dc-4e7f-b56c-c3bcb64527f9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:28.360447 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=22 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:28.361187 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:28.414073 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-973f6e83-34dc-4e7f-b56c-c3bcb64527f9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:28.421621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-973f6e83-34dc-4e7f-b56c-c3bcb64527f9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1096 microversion: 2.1 time: 0.068998 May 26 18:15:28.422184 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 503/1028] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:28 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1096 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:29.438871 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:29.439717 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:29.446290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:29.446755 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:29.447568 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:29.448012 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:29.510192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:29.517689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-74a92898-01fa-438c-84be-517c3c7c4ab3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1138 microversion: 2.1 time: 0.083103 May 26 18:15:29.518258 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 526/1029] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:29 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:30.535571 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:30.536216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:30.542578 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:30.547987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:30.547987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:30.547987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:30.611914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:30.617984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9a85860d-e263-4a70-bb71-010ddf45de5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1212 microversion: 2.1 time: 0.086823 May 26 18:15:30.629147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 504/1030] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:30 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:31.638630 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:31.639303 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:31.646325 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:31.647117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:31.647937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:31.648375 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:31.789388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:31.798679 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6b296888-cf95-4652-9170-390d62a13009 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.165496 May 26 18:15:31.808771 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 527/1031] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:31 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:31.980552 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-c413e32e-b18d-4ef0-816e-8bd5928a6b73 req-64c8f25b-a20a-451e-a595-47f0be311fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1062e4b-8237-4291-bb02-4e2bce143fdf", "tag": "b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:31.990251 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-c413e32e-b18d-4ef0-816e-8bd5928a6b73 req-64c8f25b-a20a-451e-a595-47f0be311fbf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:31.990783 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-c413e32e-b18d-4ef0-816e-8bd5928a6b73 req-64c8f25b-a20a-451e-a595-47f0be311fbf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.004404 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-c413e32e-b18d-4ef0-816e-8bd5928a6b73 req-64c8f25b-a20a-451e-a595-47f0be311fbf service nova] Creating event network-changed:b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f for instance c1062e4b-8237-4291-bb02-4e2bce143fdf on hv-cinder-83607 May 26 18:15:32.010545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-c413e32e-b18d-4ef0-816e-8bd5928a6b73 req-64c8f25b-a20a-451e-a595-47f0be311fbf service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093837 May 26 18:15:32.011858 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 505/1032] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:15:32.816439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:32.816994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:32.824669 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.825113 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.825878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:32.826310 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:32.953819 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:32.961440 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-aef53d50-803f-42ff-b86a-c1637c051b61 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.148975 May 26 18:15:32.962037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 528/1033] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:32 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:33.979003 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:33.979664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:33.986732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.987223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:33.988005 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:33.988443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:34.124579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:34.131988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a58d0654-6459-418b-96f8-1be8d46e4225 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.158058 May 26 18:15:34.132564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 506/1034] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:33 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:35.148659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:35.149275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:35.156003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.156458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.157225 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:35.157665 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:35.285774 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:35.293860 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d8708a75-9814-44ba-9003-3ee7aa0d06e7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.149090 May 26 18:15:35.294415 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 529/1035] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:35 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:36.310941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:36.311555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:36.317982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.318435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.319230 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:36.319672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:36.678033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:36.686506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0f7d978f-38e6-4f35-94f8-718b56315c5d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.379433 May 26 18:15:36.687117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 507/1036] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:36 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:37.703423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:37.704062 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:37.710493 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.710984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.711752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:37.712830 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:37.841305 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:37.848759 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6d9d1b24-538a-4dae-9883-b46ef3d15677 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.149192 May 26 18:15:37.849322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 530/1037] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:37 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:38.865061 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:38.865591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:38.868045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:38.872874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.873322 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:38.874108 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:38.874560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:39.008429 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:39.016579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-824dfee5-13fe-481f-88fc-e3bf71d029e2 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.155403 May 26 18:15:39.022848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 508/1038] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:38 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:40.033490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:40.034091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:40.035951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:40.036613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:40.042488 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:40.042972 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:40.043745 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:40.044190 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:40.175537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:40.183667 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-53ffdc4e-d253-486d-9556-1938d851c0a9 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.154023 May 26 18:15:40.184236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 531/1039] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:40 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:41.200984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:41.201592 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:41.208043 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:41.208488 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:41.209248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:41.209681 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:41.339092 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:41.346506 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-11cf407c-2d5f-4592-8122-76412f997a59 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.150290 May 26 18:15:41.347111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 509/1040] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:41 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:42.363702 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:42.373151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:42.373151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:42.373151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:42.373151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:42.373561 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:42.510549 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:42.518055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2f57e084-8e91-449c-baef-69af8fe32b8d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.158189 May 26 18:15:42.518618 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 532/1041] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:42 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:42.966914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-5f9c313d-6a11-435f-b2b5-ef6534e9812f req-e73f812f-609f-421d-af28-ae5f1be024f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1062e4b-8237-4291-bb02-4e2bce143fdf", "name": "network-vif-plugged", "status": "completed", "tag": "b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:42.975639 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5f9c313d-6a11-435f-b2b5-ef6534e9812f req-e73f812f-609f-421d-af28-ae5f1be024f7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:42.976087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-5f9c313d-6a11-435f-b2b5-ef6534e9812f req-e73f812f-609f-421d-af28-ae5f1be024f7 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:42.989458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-5f9c313d-6a11-435f-b2b5-ef6534e9812f req-e73f812f-609f-421d-af28-ae5f1be024f7 service nova] Creating event network-vif-plugged:b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f for instance c1062e4b-8237-4291-bb02-4e2bce143fdf on hv-cinder-83607 May 26 18:15:42.994788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-5f9c313d-6a11-435f-b2b5-ef6534e9812f req-e73f812f-609f-421d-af28-ae5f1be024f7 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033065 May 26 18:15:42.995556 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 510/1042] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:15:43.534847 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:43.535450 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:43.542528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:43.543015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:43.543780 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:43.544218 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:43.673307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:43.680895 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-dc3051e2-9698-439a-9dbf-ded523b3a355 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.149908 May 26 18:15:43.682378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 533/1043] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:43 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:44.700682 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:44.701355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:44.707519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:44.707964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:44.708719 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:44.709153 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:44.845738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:44.854401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-91b71338-1efe-4c55-9f99-1ab2f16a953c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1267 microversion: 2.1 time: 0.158376 May 26 18:15:44.855066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 511/1044] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:44 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:45.871915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:45.872526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:45.879064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:45.879514 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:45.880277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:45.880716 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:46.009542 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:46.017506 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-99ac4a90-918f-49f1-b3f4-793b17bbd06d tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1454 microversion: 2.1 time: 0.149454 May 26 18:15:46.018072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 534/1045] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:45 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:46.034112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:15:46.034724 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:15:46.041153 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:46.041645 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:46.042545 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:46.043017 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:46.173151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:15:46.180823 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-423deedc-eecb-45d1-b9a2-05fb64b4fbba tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1454 microversion: 2.1 time: 0.150470 May 26 18:15:46.181841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 512/1046] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:15:46 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:15:48.208615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-2717496c-c572-488d-8858-9de600187c78 req-9525f556-ad0c-451f-8d94-28a7adc57f09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1062e4b-8237-4291-bb02-4e2bce143fdf", "tag": "b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:15:48.217927 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-2717496c-c572-488d-8858-9de600187c78 req-9525f556-ad0c-451f-8d94-28a7adc57f09 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:15:48.218381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-2717496c-c572-488d-8858-9de600187c78 req-9525f556-ad0c-451f-8d94-28a7adc57f09 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:15:48.229322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-2717496c-c572-488d-8858-9de600187c78 req-9525f556-ad0c-451f-8d94-28a7adc57f09 service nova] Creating event network-changed:b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f for instance c1062e4b-8237-4291-bb02-4e2bce143fdf on hv-cinder-83607 May 26 18:15:48.234547 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-2717496c-c572-488d-8858-9de600187c78 req-9525f556-ad0c-451f-8d94-28a7adc57f09 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029527 May 26 18:15:48.235294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 535/1047] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:07.273753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:07.274672 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:07.276950 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=22 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:07.277586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=46 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:07.282837 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.283292 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.284058 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.284537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.313930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-675004da-16ba-4e60-aed1-77d584ecb9dc tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044061 May 26 18:16:07.314499 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 513/1048] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:16:07 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:16:07.370412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:07.371195 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=58 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:07.375248 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:07.375833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:07.381964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.382754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.383209 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.383653 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.409980 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:16:07.692240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3125e154-7e58-4260-b695-070233392b16 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 204 len: 0 microversion: 2.1 time: 0.323099 May 26 18:16:07.692867 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 536/1049] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:16:07 2022] DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:16:07.701256 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:07.701865 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:07.708663 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.709113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.709867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:07.710302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:07.841769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:07.849289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-acfc2245-816e-483a-b7af-d60310cdfee8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1676 microversion: 2.1 time: 0.152168 May 26 18:16:07.849855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 514/1050] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:07 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:08.866895 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:08.867602 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:08.874055 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:08.874511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:08.875294 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:08.875740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:09.004934 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:09.012475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5e9fa316-f113-4340-aa26-5b29822034df tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1676 microversion: 2.1 time: 0.149881 May 26 18:16:09.013036 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 537/1051] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:08 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:10.029591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:10.030180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:10.037381 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:10.037838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:10.038647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:10.039117 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:10.171742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:10.179313 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-62d2d364-9338-4f67-959b-f4f8fe3542f4 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1676 microversion: 2.1 time: 0.153595 May 26 18:16:10.180957 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 515/1052] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:10 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:11.094949 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:11.096403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:11.104938 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.105304 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.105983 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.106423 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.131289 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lazy-loading 'flavor' on Instance uuid adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:16:11.197609 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:11.198225 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:11.211289 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.211746 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.213242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.213242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.281601 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:11.289059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e0428bee-c93d-4948-815e-93737593a54c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1609 microversion: 2.1 time: 0.095438 May 26 18:16:11.289629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 516/1053] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:11 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1609 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:11.294199 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-2e409631-cdb9-4e30-9003-e11171696b0a req-381beed5-0aea-4362-a9a0-0e5ed157e319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86aa96be-ceb5-4d4d-8233-5f24483b0d3d", "name": "network-vif-deleted", "tag": "0aa3a8e6-218a-4fd1-97cd-833470896c93"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:11.306393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2e409631-cdb9-4e30-9003-e11171696b0a req-381beed5-0aea-4362-a9a0-0e5ed157e319 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.307302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-2e409631-cdb9-4e30-9003-e11171696b0a req-381beed5-0aea-4362-a9a0-0e5ed157e319 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.319900 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-2e409631-cdb9-4e30-9003-e11171696b0a req-381beed5-0aea-4362-a9a0-0e5ed157e319 service nova] Creating event network-vif-deleted:0aa3a8e6-218a-4fd1-97cd-833470896c93 for instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d on hv-cinder-83607 May 26 18:16:11.325462 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-2e409631-cdb9-4e30-9003-e11171696b0a req-381beed5-0aea-4362-a9a0-0e5ed157e319 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034527 May 26 18:16:11.326062 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 517/1054] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:11.475358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0762e6cb-5b0e-4841-b859-ce76adcaf9b9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "POST /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4/action" status: 202 len: 0 microversion: 2.1 time: 0.384650 May 26 18:16:11.476797 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 538/1055] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:16:11 2022] POST /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:16:11.487139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:11.487852 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:11.494162 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.496674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.498276 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:11.498925 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:11.644154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:11.651997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7db28e32-ba0f-4446-8c82-38a1574fca3e tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.170130 May 26 18:16:11.652572 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 518/1056] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:11 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:12.308034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:12.309283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:12.316071 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:12.316855 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:12.317720 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:12.318232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:12.354950 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:12.355421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:12.356233 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lazy-loading 'fault' on Instance uuid 86aa96be-ceb5-4d4d-8233-5f24483b0d3d {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:16:12.399046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:12.405946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c9f8623e-6d0e-472c-9184-64770b24585b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 200 len: 1331 microversion: 2.1 time: 0.103019 May 26 18:16:12.411254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 539/1057] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:12 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:12.669546 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:12.670152 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:12.677769 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:12.678219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:12.679413 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:12.679614 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:12.810352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:12.818690 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6a4411f3-b447-4e80-bbaf-624c68623dca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.153007 May 26 18:16:12.819284 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 519/1058] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:12 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:13.423694 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:13.424296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:13.430698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:13.431206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:13.432219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:13.432649 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:13.446095 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d HTTP/1.1 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:16:13.447776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:16:13.449437 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '86aa96be-ceb5-4d4d-8233-5f24483b0d3d'} May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:16:13.450345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:16:13.451740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:16:13.453005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:16:13.453005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3a4603e1-9069-4ae3-a8b9-9448e2a8dc65 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 404 len: 111 microversion: 2.1 time: 0.029814 May 26 18:16:13.453005 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 540/1059] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:13 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:16:13.458136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b3d38732-3a55-4c75-891e-51e6297781a5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '.version_select at 0x7f4b897e23a0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:13.566454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b3d38732-3a55-4c75-891e-51e6297781a5 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839422762" status: 202 len: 0 microversion: 2.1 time: 0.112010 May 26 18:16:13.567075 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 520/1060] 10.222.0.121 () {58 vars in 1225 bytes} [Thu May 26 18:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1839422762 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:16:13.836144 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:13.836787 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:13.842955 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:13.843413 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:13.844182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:13.844622 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:13.979325 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:13.987937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-34862e06-29d7-4e36-a8f8-ec4e148201e4 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.155668 May 26 18:16:13.988522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 541/1061] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:13 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:14.288379 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-067f38b2-719f-4f2b-84fb-ec8b304918fb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: .version_select at 0x7f4b8a2273a0>, body: {"keypair": {"name": "tempest-keypair-235979111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITUUoN/20KbWmtT5xzteuratObS68pNpsdq/zLwpXJsplRQcZvBRJDTA+zYWVowtc9VC0worTamIoKJLnWZ67dTDgxkD5chQGmuyvwy0ZgkOuAJF47Al+pxxlNLDpVjAQ=="}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:14.302756 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-067f38b2-719f-4f2b-84fb-ec8b304918fb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:16:14.306886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-067f38b2-719f-4f2b-84fb-ec8b304918fb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for user 7df2a24143654445bcb96df81e960c9d and project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'key_pairs'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:16:14.383081 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-067f38b2-719f-4f2b-84fb-ec8b304918fb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099008 May 26 18:16:14.383680 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 521/1062] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:16:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:15.005398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:15.006015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:15.012647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:15.013105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:15.013878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:15.014323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:15.146977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:15.154754 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bff7bc55-5f84-47bb-a476-2115b751bd50 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.153708 May 26 18:16:15.155290 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 542/1063] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:14 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:16.172855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:16.174090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:16.180180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:16.180630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:16.181395 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:16.182078 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:16.319436 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:16.327751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0e6df9a5-e47c-4673-b6af-17af00b2b863 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.159249 May 26 18:16:16.328323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 522/1064] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:16 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:16.677052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2018643592", "imageRef": "943cd871-500c-4dbe-9f58-0fa9a5822a80", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6294b463-76fc-4cde-9ac4-4bbb39ba02cc"}], "security_groups": [{"name": "tempest-securitygroup--1726465751"}], "key_name": "tempest-keypair-235979111", "user_data": "}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:16.777387 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.network.neutron [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] validate_networks() for [('6294b463-76fc-4cde-9ac4-4bbb39ba02cc', None, None, None, None, None)] {{(pid=130099) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:16:17.144548 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Flavor limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:16:17.144973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Image limits 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:16:17.145480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Flavor pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:16:17.145894 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Image pref 0:0:0 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:16:17.146308 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.virt.hardware [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:16:17.155499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:17.155948 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:17.156744 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:17.157180 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:17.174207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:16:17.178073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Getting quotas for user 7df2a24143654445bcb96df81e960c9d and project d0c5ea7bbd294bd7b7729aa26b6c715c. Resources: {'ram', 'instances', 'cores'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:16:17.189046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Going to run 1 instances... {{(pid=130099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:16:17.191365 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='943cd871-500c-4dbe-9f58-0fa9a5822a80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:16:17.311231 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2551586a-701f-441e-8273-3e61b7560b82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.688786 May 26 18:16:17.311905 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 543/1065] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:16:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:16:17.321961 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-6b50fb4d-d81d-4e5e-a1e9-b9b8f174e0e0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:17.322576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-6b50fb4d-d81d-4e5e-a1e9-b9b8f174e0e0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:17.351621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:17.352239 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:17.359250 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:17.359700 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:17.360478 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:17.361132 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:17.378121 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-6b50fb4d-d81d-4e5e-a1e9-b9b8f174e0e0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:17.385135 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-6b50fb4d-d81d-4e5e-a1e9-b9b8f174e0e0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1241 microversion: 2.1 time: 0.066946 May 26 18:16:17.385759 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 523/1066] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:17 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:17.490499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:17.498022 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-09cdd583-cde6-4e8b-877e-0db0d8350aa6 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.150279 May 26 18:16:17.498585 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 544/1067] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:17 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:18.402742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-eddcd1ee-c1e2-4a37-8220-6d3022c315ce tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:18.403391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-eddcd1ee-c1e2-4a37-8220-6d3022c315ce tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:18.459829 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-eddcd1ee-c1e2-4a37-8220-6d3022c315ce tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:18.466587 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-eddcd1ee-c1e2-4a37-8220-6d3022c315ce tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1241 microversion: 2.1 time: 0.067759 May 26 18:16:18.467213 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 524/1068] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:18 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:18.515869 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:18.516486 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:18.523828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:18.524281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:18.525053 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:18.525492 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:18.654872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:18.662532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-87bc8217-6945-45db-8c66-122f476b4dc1 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.150504 May 26 18:16:18.663135 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 545/1069] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:18 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:19.483007 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-761a7b9e-aa37-4cf6-a498-1d83ee68bdd7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:19.483650 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-761a7b9e-aa37-4cf6-a498-1d83ee68bdd7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:19.535921 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-761a7b9e-aa37-4cf6-a498-1d83ee68bdd7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:19.542683 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-761a7b9e-aa37-4cf6-a498-1d83ee68bdd7 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1241 microversion: 2.1 time: 0.063474 May 26 18:16:19.543277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 525/1070] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:19 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:19.679494 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:19.680047 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:19.686721 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:19.687332 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:19.688124 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:19.688572 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:19.830533 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:19.838074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d7c6c06-aea7-47d0-b0d3-f5aa76fd6c13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.162452 May 26 18:16:19.838636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 546/1071] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:19 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:20.560327 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a7750d6f-acab-48a8-a5af-c3936dc6bea3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:20.560938 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a7750d6f-acab-48a8-a5af-c3936dc6bea3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:20.613815 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a7750d6f-acab-48a8-a5af-c3936dc6bea3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:20.620684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a7750d6f-acab-48a8-a5af-c3936dc6bea3 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1241 microversion: 2.1 time: 0.064428 May 26 18:16:20.621238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 526/1072] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:20 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:20.855793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:20.856413 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:20.863425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:20.863884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:20.864656 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:20.865099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:20.999052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:21.007456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c10dcd9e-5a09-4474-a9ae-23c150915bbb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.155518 May 26 18:16:21.008037 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 547/1073] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:20 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:21.638240 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:21.638877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:21.645350 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:21.645988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:21.646757 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:21.647226 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:21.711629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:21.719157 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1d9e2313-802e-4214-a309-e8f8a1985d33 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1245 microversion: 2.1 time: 0.084721 May 26 18:16:21.719723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 527/1074] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:21 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:22.025050 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:22.025670 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:22.032371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:22.033323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:22.034108 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:22.034550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:22.172537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:22.181198 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ffd26503-8ada-4773-974c-8dae183d6fd2 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.160022 May 26 18:16:22.182793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 548/1075] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:22 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:22.737205 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:22.737888 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:22.744731 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:22.745191 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:22.745972 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:22.746419 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:22.806758 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:22.814148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-90fc6acc-7e39-4a60-b7e7-67a9bd7673fa tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1237 microversion: 2.1 time: 0.081499 May 26 18:16:22.814945 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 528/1076] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:22 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:23.199278 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:23.199880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:23.207785 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:23.208235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:23.209002 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:23.209436 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:23.341052 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:23.344623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:23.349793 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-046d05b8-1891-4d07-bd3c-767f7e11ec6d tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.154351 May 26 18:16:23.350583 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 549/1077] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:23 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:23.831453 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:23.832136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:23.838521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:23.839054 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:23.839824 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:23.840266 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:23.903221 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:23.910758 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3fbdfa92-323c-4ce3-95a4-71c3cee976f0 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1293 microversion: 2.1 time: 0.083261 May 26 18:16:23.911359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 529/1078] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:23 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:24.369187 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:24.373641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:24.377455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:24.377911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:24.378973 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:24.379479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:24.516933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:24.524499 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-fb58d660-8f9f-473b-8991-18a812cc3bb7 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.160455 May 26 18:16:24.525074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 550/1079] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:24 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:24.928159 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:24.928856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:24.935494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:24.935943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:24.936712 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:24.937215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:25.002784 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:25.010659 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-d5e5f6a1-75cd-44bb-b1a3-c87d09e690fe tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1299 microversion: 2.1 time: 0.086793 May 26 18:16:25.014647 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 530/1080] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:24 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:25.541729 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:25.542269 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:25.550365 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:25.550811 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:25.551605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:25.552039 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:25.684886 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:25.694399 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6bce773c-c18b-4a1b-ac50-c63f6e4fe4fd tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1512 microversion: 2.1 time: 0.156641 May 26 18:16:25.695377 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 551/1081] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:25 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:25.714189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:25.714802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:25.722460 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:25.722740 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:25.723566 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:25.724204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:26.029222 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:26.030123 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:26.047352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:26.047853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:26.049272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:26.049621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:26.054348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR oslo.messaging._drivers.impl_rabbit [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [d4161940-40a0-4e19-a47d-4db1d4358058] AMQP server on 10.222.0.121:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 18:16:26.211734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:26.220459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b4868084-1008-4f60-9a96-6b7171a86e1f tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.195136 May 26 18:16:26.221608 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 552/1082] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:26 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:26.233011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-0c20196e-81ca-4c26-a547-75bcee20b823 req-4ff7b8aa-a841-4aa1-bb35-3e78c43f9607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee424ca-9145-4ca3-ad5c-f6db33739399", "tag": "2fd3a8fe-df31-41fd-91df-eada83506bd3"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:26.242470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-0c20196e-81ca-4c26-a547-75bcee20b823 req-4ff7b8aa-a841-4aa1-bb35-3e78c43f9607 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:26.242940 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-0c20196e-81ca-4c26-a547-75bcee20b823 req-4ff7b8aa-a841-4aa1-bb35-3e78c43f9607 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:26.255407 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-0c20196e-81ca-4c26-a547-75bcee20b823 req-4ff7b8aa-a841-4aa1-bb35-3e78c43f9607 service nova] Creating event network-changed:2fd3a8fe-df31-41fd-91df-eada83506bd3 for instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 on hv-cinder-83607 May 26 18:16:26.260576 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-0c20196e-81ca-4c26-a547-75bcee20b823 req-4ff7b8aa-a841-4aa1-bb35-3e78c43f9607 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037505 May 26 18:16:26.261329 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 553/1083] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:27.061860 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [d4161940-40a0-4e19-a47d-4db1d4358058] Reconnected to AMQP server on 10.222.0.121:5672 via [amqp] client with port 42808. May 26 18:16:27.065941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-36342aee-6cff-4162-a745-dfabf1d15b56 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "POST /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4/action" status: 202 len: 0 microversion: 2.1 time: 1.356812 May 26 18:16:27.066767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 531/1084] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:16:25 2022] POST /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4/action => generated 0 bytes in 1358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:16:27.075663 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:27.076388 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:27.083357 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.083801 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.084776 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.085212 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.107717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-80cce6fa-a3c0-45a0-938c-db99079dca3b req-9cf41e21-9a4f-4647-82b7-e762cac82639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "name": "network-vif-unplugged", "status": "completed", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:27.120406 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-80cce6fa-a3c0-45a0-938c-db99079dca3b req-9cf41e21-9a4f-4647-82b7-e762cac82639 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.120855 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-80cce6fa-a3c0-45a0-938c-db99079dca3b req-9cf41e21-9a4f-4647-82b7-e762cac82639 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.132354 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.compute.server_external_events [req-80cce6fa-a3c0-45a0-938c-db99079dca3b req-9cf41e21-9a4f-4647-82b7-e762cac82639 service nova] Unable to find a host for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4. Dropping event network-vif-unplugged {{(pid=130100) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 18:16:27.133255 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-80cce6fa-a3c0-45a0-938c-db99079dca3b req-9cf41e21-9a4f-4647-82b7-e762cac82639 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031260 May 26 18:16:27.133856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 532/1085] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 18:16:27.165807 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.184722 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:27.238365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:27.239083 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:27.245538 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.245992 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.246762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:27.247338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:27.253919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:27.262703 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2a80e23e-4bde-462a-a42e-fe610bd54b47 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1520 microversion: 2.1 time: 0.191556 May 26 18:16:27.263710 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 554/1086] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:27 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:27.416762 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:27.424732 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-04860d2c-636a-46cc-bd0e-ea1077e64312 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.190763 May 26 18:16:27.425375 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 533/1087] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:27 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:28.281413 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:28.281997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:28.289884 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.290330 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:28.291120 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.291554 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:28.420161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:28.428451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e18d8898-4a4e-4915-8a48-7dbcd0c826ca tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1520 microversion: 2.1 time: 0.150954 May 26 18:16:28.429020 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 555/1088] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:28 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:28.441250 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:28.441849 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:28.448257 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.448706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:28.449464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:28.450009 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:28.581901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:28.589208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-66dcb8fc-6fd3-4439-9e1b-7bfa1ebf8a61 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.151763 May 26 18:16:28.589768 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 534/1089] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:28 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:29.447086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:29.447702 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:29.454186 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:29.454636 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:29.456394 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:29.456834 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:29.472251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:16:29.472574 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 (ip 10.222.0.121) !!! May 26 18:16:29.591470 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:29.599378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3c65854b-5c69-47c3-9c0c-65228bd17723 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1522 microversion: 2.1 time: 0.156302 May 26 18:16:29.600208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 556/1090] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:29 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:29.607621 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:29.608243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:29.614760 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:29.615244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:29.616076 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:29.616512 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:29.746378 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:29.749895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:29.754843 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4c2d0f2c-8ca8-4a8a-ab0c-cbf362d92022 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.152097 May 26 18:16:29.760751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 535/1091] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:29 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:30.617610 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:30.618223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:30.624800 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.625253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.626016 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.626458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.760613 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:30.770287 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a320cb84-adc5-43ee-95fe-5ebc460094fb tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.155562 May 26 18:16:30.770996 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 557/1092] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:30 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:30.772594 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:30.773212 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:30.777715 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=12 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:30.781651 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.782224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.783771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:30.784338 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:30.918741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:30.926599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e746fe56-17bf-448c-8be9-2760648f6328 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.158269 May 26 18:16:30.927196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 536/1093] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:30 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:31.789021 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:31.789646 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:31.796081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.796528 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:31.797277 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.797711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:31.933027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:31.941862 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6ff8987a-3f2b-4796-b85f-05beb073b47f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.157612 May 26 18:16:31.944573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 558/1094] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:31 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:31.944696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:31.944696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:31.951180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.951641 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:31.952417 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:31.952862 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:32.084174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:32.091649 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ce2f89b0-943f-4744-afd0-5c566f92b928 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.151899 May 26 18:16:32.092215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 537/1095] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:31 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:32.959696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:32.960304 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:32.966899 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:32.967350 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:32.968148 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:32.968582 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:33.103459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:33.109541 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:33.109935 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:33.111697 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7632fdbe-4b3d-4452-9a32-d22a22db4a13 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.155710 May 26 18:16:33.112275 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 559/1096] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:32 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:33.118143 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:33.118661 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:33.119526 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:33.120033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:33.251002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:33.259047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-15c3c24e-eda3-44b9-9100-e5b0c9764e82 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.153702 May 26 18:16:33.259839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 538/1097] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:33 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:33.261616 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-81306c9d-eb4d-420d-be94-295b0e7835d0 req-eefa8489-450f-418b-a30f-19eadd22d653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee424ca-9145-4ca3-ad5c-f6db33739399", "name": "network-vif-plugged", "status": "completed", "tag": "2fd3a8fe-df31-41fd-91df-eada83506bd3"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:33.270604 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-81306c9d-eb4d-420d-be94-295b0e7835d0 req-eefa8489-450f-418b-a30f-19eadd22d653 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:33.272202 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-81306c9d-eb4d-420d-be94-295b0e7835d0 req-eefa8489-450f-418b-a30f-19eadd22d653 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:33.282102 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-81306c9d-eb4d-420d-be94-295b0e7835d0 req-eefa8489-450f-418b-a30f-19eadd22d653 service nova] Creating event network-vif-plugged:2fd3a8fe-df31-41fd-91df-eada83506bd3 for instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 on hv-cinder-83607 May 26 18:16:33.288106 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-81306c9d-eb4d-420d-be94-295b0e7835d0 req-eefa8489-450f-418b-a30f-19eadd22d653 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 May 26 18:16:33.288693 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 560/1098] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:16:34.129524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:34.130118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:34.136868 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.137321 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.138082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.138520 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.267558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:34.275174 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ad1206a5-3142-47ee-b79e-60a0b25f163f tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.150112 May 26 18:16:34.275748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 539/1099] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:34 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:34.275891 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:34.276498 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:34.283480 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.283936 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.284714 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:34.285155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:34.417674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:34.425841 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-618dd378-23cc-44b8-82bf-cbf5ed5a6549 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.154280 May 26 18:16:34.426411 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 561/1100] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:34 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:35.292376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:35.292997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:35.299492 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.303227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.303227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.303227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.433046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:35.441529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e79aaba7-2fec-4007-8286-174f9c8a28a9 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.153070 May 26 18:16:35.442104 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 540/1101] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:35 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:35.443259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:35.443878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:35.450339 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.450790 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.454560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:35.454560 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:35.584391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:35.591853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-166a7bf9-68d7-4466-ae0b-2a91e611016b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1367 microversion: 2.1 time: 0.153046 May 26 18:16:35.592408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 562/1102] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:35 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:36.459311 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:36.459984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:36.466432 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.466909 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.467678 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.468112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.598490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:36.606139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-be7d9e29-e72c-4b44-8ea0-48bcb225167b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.151379 May 26 18:16:36.606703 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 541/1103] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:36 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:36.607908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:36.608527 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:36.614981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.615430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.616196 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.616629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.743758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:36.752066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3f210f11-ee88-4df8-a8ad-fb103f87050d tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1553 microversion: 2.1 time: 0.147974 May 26 18:16:36.752690 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 563/1104] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:36 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:16:36.768763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:36.769298 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:36.775259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.775709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.776468 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:36.776902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:36.854706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ce716afa-2149-48c7-8f9a-88904ca8fb26 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090373 May 26 18:16:36.855334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 542/1105] 10.222.0.121 () {58 vars in 1279 bytes} [Thu May 26 18:16:36 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:37.623460 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:37.624046 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:37.626637 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:37.631775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:37.632223 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:37.632986 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:37.633421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:37.875586 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:37.884279 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-92a8cda2-d888-4316-81b1-005ae802f916 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.264710 May 26 18:16:37.884870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 564/1106] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:37 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:38.138086 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-07ed33a2-a90b-4979-80ae-26fd92908e0f req-8255eed5-fb55-4c89-8d3f-4d2da5a2dcd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee424ca-9145-4ca3-ad5c-f6db33739399", "tag": "2fd3a8fe-df31-41fd-91df-eada83506bd3"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:38.141625 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:38.147898 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-07ed33a2-a90b-4979-80ae-26fd92908e0f req-8255eed5-fb55-4c89-8d3f-4d2da5a2dcd4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:38.148353 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-07ed33a2-a90b-4979-80ae-26fd92908e0f req-8255eed5-fb55-4c89-8d3f-4d2da5a2dcd4 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:38.162979 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-07ed33a2-a90b-4979-80ae-26fd92908e0f req-8255eed5-fb55-4c89-8d3f-4d2da5a2dcd4 service nova] Creating event network-changed:2fd3a8fe-df31-41fd-91df-eada83506bd3 for instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 on hv-cinder-83607 May 26 18:16:38.168195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-07ed33a2-a90b-4979-80ae-26fd92908e0f req-8255eed5-fb55-4c89-8d3f-4d2da5a2dcd4 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034242 May 26 18:16:38.168997 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 543/1107] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:38.902281 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:38.903631 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:38.911035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:38.911659 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:38.912467 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:38.912911 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:39.059709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:39.068833 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7593fca9-985c-42dd-a401-76b878c16105 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.171058 May 26 18:16:39.074859 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 565/1108] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:38 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:40.086469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:40.087256 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:40.094280 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:40.094741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:40.095531 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:40.095958 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:40.235943 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:40.243467 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-dc189eb8-7e99-4d2c-a666-a03ca795d038 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.161733 May 26 18:16:40.244033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 544/1109] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:40 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:41.260872 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:41.261888 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:41.269206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:41.269920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:41.270732 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:41.271197 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:41.319494 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-d9205b43-22d7-44b8-9405-e55c77236c90 req-7980771a-eb50-4e8f-9c28-8c1bdf5973f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "name": "network-vif-plugged", "status": "completed", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:16:41.327627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d9205b43-22d7-44b8-9405-e55c77236c90 req-7980771a-eb50-4e8f-9c28-8c1bdf5973f0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:41.328082 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-d9205b43-22d7-44b8-9405-e55c77236c90 req-7980771a-eb50-4e8f-9c28-8c1bdf5973f0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:41.341611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-d9205b43-22d7-44b8-9405-e55c77236c90 req-7980771a-eb50-4e8f-9c28-8c1bdf5973f0 service nova] Creating event network-vif-plugged:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:16:41.348411 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-d9205b43-22d7-44b8-9405-e55c77236c90 req-7980771a-eb50-4e8f-9c28-8c1bdf5973f0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087761 May 26 18:16:41.349148 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 545/1110] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:16:41.412788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:41.420494 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3acc527f-90ea-4e42-a75f-d8d50c991a2a tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.163540 May 26 18:16:41.421070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 566/1111] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:41 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:42.439491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:42.440474 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:42.447334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:42.448702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:42.448702 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:42.449053 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:42.584383 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:42.592158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b7f2f9a8-23df-40a2-8f01-aa26ac1da2a5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.156933 May 26 18:16:42.592733 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 546/1112] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:42 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:43.609327 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:43.609935 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:43.617408 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:43.617870 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:43.618680 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:43.619157 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:43.755887 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:43.759476 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=100 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:43.763806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eb2f3dd8-099b-4ff7-8d30-a3074feb8987 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1578 microversion: 2.1 time: 0.158354 May 26 18:16:43.764375 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 567/1113] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:43 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:16:44.780836 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:16:44.781391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:16:44.787946 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:44.788398 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:44.789160 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:16:44.789597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:16:44.926674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:16:44.934729 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-466dcea4-caad-4814-9a66-0db4ea6af968 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1565 microversion: 2.1 time: 0.158035 May 26 18:16:44.935495 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 547/1114] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:16:44 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:52.756734 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=7 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:52.757365 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-98cbee94-7559-40e5-b56a-fe5fcb76676c req-2b321b7a-e999-4cf3-8f0f-a9dc2ec45587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1062e4b-8237-4291-bb02-4e2bce143fdf", "tag": "b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:52.757851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:52.757851 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:52.758042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=9 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:52.758042 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=62 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:52.760784 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:52.761457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:52.761716 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-98cbee94-7559-40e5-b56a-fe5fcb76676c req-2b321b7a-e999-4cf3-8f0f-a9dc2ec45587 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:52.762235 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:52.762358 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-98cbee94-7559-40e5-b56a-fe5fcb76676c req-2b321b7a-e999-4cf3-8f0f-a9dc2ec45587 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:52.763137 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:52.774028 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-98cbee94-7559-40e5-b56a-fe5fcb76676c req-2b321b7a-e999-4cf3-8f0f-a9dc2ec45587 service nova] Creating event network-changed:b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f for instance c1062e4b-8237-4291-bb02-4e2bce143fdf on hv-cinder-83607 May 26 18:17:52.780723 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-98cbee94-7559-40e5-b56a-fe5fcb76676c req-2b321b7a-e999-4cf3-8f0f-a9dc2ec45587 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 May 26 18:17:52.781574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 548/1115] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:17:52.792876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:17:53.068111 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3bcf8c66-0d1e-4c56-8a4b-f601e12a4f6c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "DELETE /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 204 len: 0 microversion: 2.1 time: 0.322848 May 26 18:17:53.068699 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 568/1116] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:17:52 2022] DELETE /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:17:53.082133 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:53.082861 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:53.091014 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:53.096366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:53.097742 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:53.098405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:53.242802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:53.250608 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b682063d-ff26-4ce4-b56f-ee3bc6ccfa08 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1579 microversion: 2.1 time: 0.172649 May 26 18:17:53.251209 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 549/1117] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:17:53 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:53.467292 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:53.467879 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:53.474421 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:53.475161 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:53.475831 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:53.476977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:53.501958 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-2b07fa60-a6d6-46ce-b88c-a8dda42523c2 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/ips" status: 200 len: 146 microversion: 2.1 time: 0.038848 May 26 18:17:53.502451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 569/1118] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:17:53 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:17:54.268577 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:54.269144 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:54.275794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:54.276258 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:54.277029 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:54.277471 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:54.415201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:54.422626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-cb05109c-91f0-41d7-ae12-4647449d10ab tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1579 microversion: 2.1 time: 0.157969 May 26 18:17:54.425788 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 550/1119] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:17:54 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:55.107638 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33683c78-71b0-4e18-9eab-07bb1dd9be0e"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:55.108719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:55.115257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:55.115770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.116490 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:55.116930 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.441919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:55.442751 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:55.449628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:55.450077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.450873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:55.451318 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.518867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:55.528873 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-b595ebb7-cf7a-4e55-bd12-648527b6d80c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1393 microversion: 2.1 time: 0.090649 May 26 18:17:55.530196 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 551/1120] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:17:55 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1393 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:17:55.589143 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-9da75199-2fd9-49df-8d7e-eaafebb103a2 req-1157999d-4a53-4b07-83ee-7262f6063712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1062e4b-8237-4291-bb02-4e2bce143fdf", "name": "network-vif-deleted", "tag": "b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:17:55.598831 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-9da75199-2fd9-49df-8d7e-eaafebb103a2 req-1157999d-4a53-4b07-83ee-7262f6063712 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:55.599302 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-9da75199-2fd9-49df-8d7e-eaafebb103a2 req-1157999d-4a53-4b07-83ee-7262f6063712 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:55.610283 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-9da75199-2fd9-49df-8d7e-eaafebb103a2 req-1157999d-4a53-4b07-83ee-7262f6063712 service nova] Creating event network-vif-deleted:b5a3f96a-a6a3-4b1c-a53d-7de8027e6c9f for instance c1062e4b-8237-4291-bb02-4e2bce143fdf on hv-cinder-83607 May 26 18:17:55.615519 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-9da75199-2fd9-49df-8d7e-eaafebb103a2 req-1157999d-4a53-4b07-83ee-7262f6063712 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032493 May 26 18:17:55.616905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 552/1121] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:17:55.910412 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-d9c4b5fc-0301-48d8-8281-ccdd2595b504 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.806543 May 26 18:17:55.916236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 570/1122] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:17:55 2022] POST /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:17:56.547562 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:56.548428 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:56.555243 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:56.555880 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:56.556986 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:56.557685 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:56.590615 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:56.591136 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:56.591524 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lazy-loading 'fault' on Instance uuid c1062e4b-8237-4291-bb02-4e2bce143fdf {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:17:56.632606 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:17:56.640794 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ab660ddb-64da-437d-9192-7aa300499347 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 200 len: 1232 microversion: 2.1 time: 0.098196 May 26 18:17:56.644809 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 553/1123] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:17:56 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 1232 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:17:57.660030 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:17:57.660696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: c1062e4b-8237-4291-bb02-4e2bce143fdf] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:17:57.668203 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:57.668655 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:57.669640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:17:57.670160 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:17:57.684425 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] HTTP exception thrown: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Request method failure captured: May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf HTTP/1.1 May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8JUSPOpkxr2NmgtbJRsP_qO3mpI2kfgS7-sjGb9xIdSr1p1BTDqx8hkG2QwJKRNKX0tlA4YIeEPHFm-jifoP81Xdzj0ZlxLq7aJibU0UgNCPpeSQDzQj2ZpW9GHoFNx6xeokmMrKblJZvD2QbOio2cebeYtroDAvdLdqOfuFopx4vo May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:17:57.691557 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7daf2a694ab840949d8cf403c2573bda", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-TestVolumeBootPattern-1256171076 May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-TestVolumeBootPattern-1256171076-project May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: e7e74d9bfa6144ae8ad7e3156fb42e6e May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-TestVolumeBootPattern-1256171076-project May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. May 26 18:17:57.693272 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': 'c1062e4b-8237-4291-bb02-4e2bce143fdf'} May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:17:57.694333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. May 26 18:17:57.695956 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:17:57.697367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Returning 404 to user: Instance c1062e4b-8237-4291-bb02-4e2bce143fdf could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:17:57.697367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-db979813-bdfe-479e-92f4-ec73abd956a3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf" status: 404 len: 111 microversion: 2.1 time: 0.032402 May 26 18:17:57.697367 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 571/1124] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:17:57 2022] GET /compute/v2.1/servers/c1062e4b-8237-4291-bb02-4e2bce143fdf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:01.258053 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:01.259015 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:01.259891 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-cabc20ef-8779-4c03-855d-042080d9c027 req-ecf267be-d4b6-4d61-9ae0-7ebf3381cd4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8db37847-310c-4822-848c-d10ff3623677", "tag": "f0780c28-b166-4478-93b7-810e8d90b249"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:01.268256 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:01.269259 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:01.269689 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-cabc20ef-8779-4c03-855d-042080d9c027 req-ecf267be-d4b6-4d61-9ae0-7ebf3381cd4a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:01.270151 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-cabc20ef-8779-4c03-855d-042080d9c027 req-ecf267be-d4b6-4d61-9ae0-7ebf3381cd4a service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:01.270910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:01.271561 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:01.282904 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-cabc20ef-8779-4c03-855d-042080d9c027 req-ecf267be-d4b6-4d61-9ae0-7ebf3381cd4a service nova] Creating event network-changed:f0780c28-b166-4478-93b7-810e8d90b249 for instance 8db37847-310c-4822-848c-d10ff3623677 on hv-cinder-83607 May 26 18:18:01.288981 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-cabc20ef-8779-4c03-855d-042080d9c027 req-ecf267be-d4b6-4d61-9ae0-7ebf3381cd4a service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032669 May 26 18:18:01.293029 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 572/1125] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:01.305049 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:18:01.654208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-30e01dcf-ff14-46f7-a45d-88a84947daa3 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 204 len: 0 microversion: 2.1 time: 0.400292 May 26 18:18:01.656886 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 554/1126] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:01 2022] DELETE /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:18:01.663838 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:01.664590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:01.671994 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:01.672538 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:01.673398 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:01.673919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:01.810920 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:01.818503 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e2688f65-931c-45f6-9c23-79f2e2a10d04 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1580 microversion: 2.1 time: 0.158933 May 26 18:18:01.819108 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 573/1127] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:01 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1580 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:02.836308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:02.836923 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:02.843778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:02.844233 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:02.845001 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:02.845440 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:02.979871 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:02.988521 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-c1eae2e8-a0da-43a0-8b4d-f2b202101ff7 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1580 microversion: 2.1 time: 0.156569 May 26 18:18:02.989090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 555/1128] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:02 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1580 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:04.006767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:04.007416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:04.014692 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.015163 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.015939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.016385 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.160011 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:04.168063 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f6bda5f5-704e-4d02-a5a4-d8846bc6a1c6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1461 microversion: 2.1 time: 0.165257 May 26 18:18:04.168629 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 574/1129] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:04 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1461 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:04.425386 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-43651d74-0abd-45db-b806-f24ea42eb37e req-e693d0bc-a478-479a-92f7-48ac09876eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8db37847-310c-4822-848c-d10ff3623677", "name": "network-vif-deleted", "tag": "f0780c28-b166-4478-93b7-810e8d90b249"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:04.434185 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-43651d74-0abd-45db-b806-f24ea42eb37e req-e693d0bc-a478-479a-92f7-48ac09876eb2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.434691 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-43651d74-0abd-45db-b806-f24ea42eb37e req-e693d0bc-a478-479a-92f7-48ac09876eb2 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.446779 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-43651d74-0abd-45db-b806-f24ea42eb37e req-e693d0bc-a478-479a-92f7-48ac09876eb2 service nova] Creating event network-vif-deleted:f0780c28-b166-4478-93b7-810e8d90b249 for instance 8db37847-310c-4822-848c-d10ff3623677 on hv-cinder-83607 May 26 18:18:04.453106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-43651d74-0abd-45db-b806-f24ea42eb37e req-e693d0bc-a478-479a-92f7-48ac09876eb2 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031219 May 26 18:18:04.453710 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 556/1130] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:04.668536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:04.669553 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:04.675796 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.676254 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.677035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.677477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.712552 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b2b691d8-95ac-44ad-9281-4ee63d423072 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047991 May 26 18:18:04.713131 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 575/1131] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:18:04 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:04.723975 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:04.724558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:04.730928 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.731375 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.732175 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:04.732593 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:04.762934 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8dd792eb-9c74-443e-98dd-de8b76d6359c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e" status: 200 len: 194 microversion: 2.1 time: 0.043155 May 26 18:18:04.764586 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 557/1132] 10.222.0.121 () {58 vars in 1417 bytes} [Thu May 26 18:18:04 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:18:05.187330 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:05.187892 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:05.194711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.195197 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.195977 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.196418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.229783 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:05.230228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:05.230751 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lazy-loading 'fault' on Instance uuid 8db37847-310c-4822-848c-d10ff3623677 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:05.273118 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e74d9bfa6144ae8ad7e3156fb42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7daf2a694ab840949d8cf403c2573bda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:05.281615 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4c06395c-32b8-4bae-a683-c2b360176493 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 200 len: 1233 microversion: 2.1 time: 0.099504 May 26 18:18:05.282182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 576/1133] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:05 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 1233 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:06.299463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:06.300080 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: 8db37847-310c-4822-848c-d10ff3623677] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:06.306573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.309222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.309222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.309222 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.321838 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] HTTP exception thrown: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Request method failure captured: May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 HTTP/1.1 May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8JUSPOpkxr2NmgtbJRsP_qO3mpI2kfgS7-sjGb9xIdSr1p1BTDqx8hkG2QwJKRNKX0tlA4YIeEPHFm-jifoP81Xdzj0ZlxLq7aJibU0UgNCPpeSQDzQj2ZpW9GHoFNx6xeokmMrKblJZvD2QbOio2cebeYtroDAvdLdqOfuFopx4vo May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:06.323511 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7daf2a694ab840949d8cf403c2573bda", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: e7e74d9bfa6144ae8ad7e3156fb42e6e May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. May 26 18:18:06.325065 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '8db37847-310c-4822-848c-d10ff3623677'} May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:06.325980 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. May 26 18:18:06.327490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.328839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Returning 404 to user: Instance 8db37847-310c-4822-848c-d10ff3623677 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:06.328839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2175c5a5-d70b-4dd2-963e-318bd9a10204 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677" status: 404 len: 111 microversion: 2.1 time: 0.029968 May 26 18:18:06.328839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 558/1134] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:06 2022] GET /compute/v2.1/servers/8db37847-310c-4822-848c-d10ff3623677 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:06.493101 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8454647-fe80-4bc8-b556-9ffea544da0e"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:06.494264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:06.501603 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.502056 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.502910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.503293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.876433 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:06.876926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:06.882942 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.883393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.884154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.884591 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.898981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] HTTP exception thrown: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Request method failure captured: May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 HTTP/1.1 May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8JUSPOpkxr2NmgtbJRsP_qO3mpI2kfgS7-sjGb9xIdSr1p1BTDqx8hkG2QwJKRNKX0tlA4YIeEPHFm-jifoP81Xdzj0ZlxLq7aJibU0UgNCPpeSQDzQj2ZpW9GHoFNx6xeokmMrKblJZvD2QbOio2cebeYtroDAvdLdqOfuFopx4vo May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:06.900543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7daf2a694ab840949d8cf403c2573bda", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: e7e74d9bfa6144ae8ad7e3156fb42e6e May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.902195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': 'ba3c61ea-ea27-4ef4-a252-9e4893a80974'} May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:06.903127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.904576 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.906164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Returning 404 to user: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:06.906164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3a1cfaf7-5086-4edb-ac19-0c9dce2bf70c tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "DELETE /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 404 len: 111 microversion: 2.1 time: 0.030138 May 26 18:18:06.906164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 559/1135] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:06 2022] DELETE /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:18:06.910293 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:06.910839 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] [instance: ba3c61ea-ea27-4ef4-a252-9e4893a80974] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:06.916638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.917084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.917856 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:06.918273 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:06.933666 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] HTTP exception thrown: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Request method failure captured: May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 HTTP/1.1 May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8JUSPOpkxr2NmgtbJRsP_qO3mpI2kfgS7-sjGb9xIdSr1p1BTDqx8hkG2QwJKRNKX0tlA4YIeEPHFm-jifoP81Xdzj0ZlxLq7aJibU0UgNCPpeSQDzQj2ZpW9GHoFNx6xeokmMrKblJZvD2QbOio2cebeYtroDAvdLdqOfuFopx4vo May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:06.935229 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/7daf2a694ab840949d8cf403c2573bda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_7daf2a694ab840949d8cf403c2573bda", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 7daf2a694ab840949d8cf403c2573bda May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestVolumeBootPattern-1256171076 May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: e7e74d9bfa6144ae8ad7e3156fb42e6e May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestVolumeBootPattern-1256171076-project May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.937640 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': 'ba3c61ea-ea27-4ef4-a252-9e4893a80974'} May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:06.938485 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. May 26 18:18:06.940034 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:06.942204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Returning 404 to user: Instance ba3c61ea-ea27-4ef4-a252-9e4893a80974 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:06.942204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-7d140946-f322-4bf7-be68-3f62e374cfd6 tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974" status: 404 len: 111 microversion: 2.1 time: 0.030570 May 26 18:18:06.942204 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 560/1136] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:06 2022] GET /compute/v2.1/servers/ba3c61ea-ea27-4ef4-a252-9e4893a80974 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:07.397167 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-6f943b10-381d-4fab-809f-3e98df859823 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "POST /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908245 May 26 18:18:07.397932 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 577/1137] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:18:06 2022] POST /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:08.483848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-448bc61b-e7ef-4f39-b63b-1563b7203cda tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] Calling method '.version_select at 0x7f4b8a225160>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:08.611090 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-448bc61b-e7ef-4f39-b63b-1563b7203cda tempest-TestVolumeBootPattern-1256171076 tempest-TestVolumeBootPattern-1256171076-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-303959824" status: 202 len: 0 microversion: 2.1 time: 0.131440 May 26 18:18:08.611700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 561/1138] 10.222.0.121 () {58 vars in 1264 bytes} [Thu May 26 18:18:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-303959824 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:18:16.037704 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:16.038844 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:16.045370 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.045826 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.046609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.047079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.079378 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-67b0ed79-18a2-432b-a43b-ccc534615520 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047446 May 26 18:18:16.080415 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 578/1139] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:18:16 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:16.234776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:16.234776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:16.241622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.242086 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.242891 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.243341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.273486 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ecdcb617-640c-472b-bafe-20be7ad2a9c8 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e" status: 200 len: 194 microversion: 2.1 time: 0.046326 May 26 18:18:16.274084 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 562/1140] 10.222.0.121 () {58 vars in 1417 bytes} [Thu May 26 18:18:16 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:16.287564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:16.288074 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:16.293997 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.294451 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.295251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:16.295698 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:16.378711 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lazy-loading 'services' on Instance uuid 8ee424ca-9145-4ca3-ad5c-f6db33739399 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:16.716514 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-92af22b0-1f2a-487c-9801-685a55e76921 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e" status: 202 len: 0 microversion: 2.1 time: 0.433063 May 26 18:18:16.717105 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 579/1141] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:18:16 2022] DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/33683c78-71b0-4e18-9eab-07bb1dd9be0e => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:18:18.907151 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:18.907700 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:18.914443 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.914932 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.915817 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.916238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.945529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f204f3d3-407d-49f9-82c5-3a3bc1c95f8b tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/a8454647-fe80-4bc8-b556-9ffea544da0e" status: 200 len: 194 microversion: 2.1 time: 0.042246 May 26 18:18:18.946107 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 563/1142] 10.222.0.121 () {58 vars in 1417 bytes} [Thu May 26 18:18:18 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/a8454647-fe80-4bc8-b556-9ffea544da0e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:18.957919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:18.958508 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:18.964718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.965173 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:18.965944 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:18.966391 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:19.045590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:19.049562 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lazy-loading 'services' on Instance uuid 8ee424ca-9145-4ca3-ad5c-f6db33739399 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:19.288848 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-5c955f4f-b543-4eb0-8a7b-89b9aabd6751 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/a8454647-fe80-4bc8-b556-9ffea544da0e" status: 202 len: 0 microversion: 2.1 time: 0.336359 May 26 18:18:19.289439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 580/1143] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:18:18 2022] DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments/a8454647-fe80-4bc8-b556-9ffea544da0e => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:18:20.452892 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:20.453808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:20.461176 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.461622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.462392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.462947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.491798 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-1208c8df-3f9b-4b7a-8761-686f77a3f0cb tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042893 May 26 18:18:20.492344 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 564/1144] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:18:20 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:18:20.603501 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:20.604038 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:20.610169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.610617 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.611464 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.611933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.644559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4f502a19-a931-456d-a5c6-708c4420bf87 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046463 May 26 18:18:20.645032 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 581/1145] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:18:20 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:18:20.703141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:20.703706 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:20.710057 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.710513 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.717899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:20.717899 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:20.738155 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:18:20.831558 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:20.990670 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9c6eabd3-99f2-4640-b50e-a41b8645b2ca tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 204 len: 0 microversion: 2.1 time: 0.291040 May 26 18:18:20.991334 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 565/1146] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:20 2022] DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:18:20.999591 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:21.000207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:21.007049 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.007500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.008270 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:21.008708 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:21.145485 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:21.153227 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-c467aa8f-8457-4477-82ed-d9eaef74b14c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1678 microversion: 2.1 time: 0.157609 May 26 18:18:21.153828 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 582/1147] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:20 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:18:22.171763 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:22.172454 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:22.179905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.180349 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.181109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:22.181549 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:22.313418 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:22.321149 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ebead555-e3e3-447d-a3e5-9eefe1884c83 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1678 microversion: 2.1 time: 0.153564 May 26 18:18:22.321721 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 566/1148] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:22 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:23.341941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:23.342964 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:23.346342 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:23.352283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.352743 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.353530 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:23.353970 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:23.497597 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:23.505910 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0ef4e63c-529b-4ee8-a13d-3c1fab952505 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1678 microversion: 2.1 time: 0.169924 May 26 18:18:23.506487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 583/1149] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:23 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:24.032113 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-f6482679-17ff-4334-a3a8-e1d488af1e01 req-27968178-558c-4ee3-a07a-257f829712e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee424ca-9145-4ca3-ad5c-f6db33739399", "name": "network-vif-deleted", "tag": "2fd3a8fe-df31-41fd-91df-eada83506bd3"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:24.038105 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:18:24.044224 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f6482679-17ff-4334-a3a8-e1d488af1e01 req-27968178-558c-4ee3-a07a-257f829712e9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.044981 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-f6482679-17ff-4334-a3a8-e1d488af1e01 req-27968178-558c-4ee3-a07a-257f829712e9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.063766 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-f6482679-17ff-4334-a3a8-e1d488af1e01 req-27968178-558c-4ee3-a07a-257f829712e9 service nova] Creating event network-vif-deleted:2fd3a8fe-df31-41fd-91df-eada83506bd3 for instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 on hv-cinder-83607 May 26 18:18:24.079340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-f6482679-17ff-4334-a3a8-e1d488af1e01 req-27968178-558c-4ee3-a07a-257f829712e9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050742 May 26 18:18:24.080575 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 567/1150] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:24.523605 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:24.524286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:24.532657 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.533426 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.534253 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.535504 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.572344 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:24.576976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:24.576976 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lazy-loading 'fault' on Instance uuid 8ee424ca-9145-4ca3-ad5c-f6db33739399 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:24.632753 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7df2a24143654445bcb96df81e960c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0c5ea7bbd294bd7b7729aa26b6c715c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:24.643158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4d478e81-8253-48ea-9777-c451989c48b9 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 200 len: 1331 microversion: 2.1 time: 0.124217 May 26 18:18:24.644099 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 584/1151] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:24 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:25.054734 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.062362 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:25.063290 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.063748 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.064771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.065400 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.092622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Going to try to terminate instance {{(pid=130100) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:18:25.590776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-167b23ca-b1cd-41fc-a4e6-9b45396a2b2b tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "DELETE /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 204 len: 0 microversion: 2.1 time: 0.539975 May 26 18:18:25.591341 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 568/1152] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:25 2022] DELETE /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:18:25.600231 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.600933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:25.607590 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.608457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.608861 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.609307 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.662725 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.663484 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:25.669920 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.670555 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.671458 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:25.671901 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:25.688219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 HTTP/1.1 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:25.689982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:25.695704 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '8ee424ca-9145-4ca3-ad5c-f6db33739399'} May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:25.697228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:25.698933 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:25.700310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:25.700310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-880aaca0-aacc-461e-a802-9ef5d42d1e08 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 404 len: 111 microversion: 2.1 time: 0.034123 May 26 18:18:25.700310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 569/1153] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:25 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 18:18:25.701853 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-aeeed0a5-fff8-4cb8-a1e6-c3a01ea2c720 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '.version_select at 0x7f4b8ea218b0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:25.755323 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:25.763362 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-f2e2eec9-f670-4bdd-8a18-d214309e8e24 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.167436 May 26 18:18:25.763948 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 585/1154] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:25 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:25.782261 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-aeeed0a5-fff8-4cb8-a1e6-c3a01ea2c720 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235979111" status: 202 len: 0 microversion: 2.1 time: 0.084742 May 26 18:18:25.782874 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 570/1155] 10.222.0.121 () {58 vars in 1222 bytes} [Thu May 26 18:18:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235979111 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:18:26.123742 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-23a4fbf9-e37b-4903-a5c3-9570dbcfaee1 req-aa74b488-1b87-40e8-8b85-f9a2e1e98ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:26.132541 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-23a4fbf9-e37b-4903-a5c3-9570dbcfaee1 req-aa74b488-1b87-40e8-8b85-f9a2e1e98ef0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.132993 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-23a4fbf9-e37b-4903-a5c3-9570dbcfaee1 req-aa74b488-1b87-40e8-8b85-f9a2e1e98ef0 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.145532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-23a4fbf9-e37b-4903-a5c3-9570dbcfaee1 req-aa74b488-1b87-40e8-8b85-f9a2e1e98ef0 service nova] Creating event network-changed:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:18:26.150188 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-23a4fbf9-e37b-4903-a5c3-9570dbcfaee1 req-aa74b488-1b87-40e8-8b85-f9a2e1e98ef0 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030437 May 26 18:18:26.151154 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 586/1156] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:26.781638 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:26.782248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:26.790180 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.790507 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.794040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:26.794040 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:26.932931 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:26.940475 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-84fa2216-5367-498a-8c2e-b876a5756612 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1571 microversion: 2.1 time: 0.163334 May 26 18:18:26.941033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 571/1157] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:26 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:27.960159 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:27.960916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:27.967837 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.968297 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:27.969091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:27.969532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.041313 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:28.049245 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7ff72329-72ba-4075-8b20-b60e406572c5 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1385 microversion: 2.1 time: 0.095205 May 26 18:18:28.060472 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 587/1158] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:27 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:28.165914 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-6f151d7f-a87d-4e1d-8500-263cd5964f91 req-0b90f0f6-5f2e-4f35-9dc9-d2ed7e505a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adfbfda7-6eaf-45cc-92d8-e4b42a1143f4", "name": "network-vif-deleted", "tag": "02a88c0a-884d-40bb-bf43-c7449aba6dfc"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:28.174514 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-6f151d7f-a87d-4e1d-8500-263cd5964f91 req-0b90f0f6-5f2e-4f35-9dc9-d2ed7e505a79 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:28.175508 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-6f151d7f-a87d-4e1d-8500-263cd5964f91 req-0b90f0f6-5f2e-4f35-9dc9-d2ed7e505a79 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:28.187789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-6f151d7f-a87d-4e1d-8500-263cd5964f91 req-0b90f0f6-5f2e-4f35-9dc9-d2ed7e505a79 service nova] Creating event network-vif-deleted:02a88c0a-884d-40bb-bf43-c7449aba6dfc for instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 on hv-cinder-83607 May 26 18:18:28.200047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-6f151d7f-a87d-4e1d-8500-263cd5964f91 req-0b90f0f6-5f2e-4f35-9dc9-d2ed7e505a79 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031510 May 26 18:18:28.200047 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 572/1159] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:29.067003 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.067643 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.074358 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.074808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.075624 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.076066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.113017 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.113483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.113951 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lazy-loading 'fault' on Instance uuid adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:18:29.155403 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdc1042ea3b54768ab87e1f66e74ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a50fbd483e2e4d8886ae5d6341af7dcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:18:29.164158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-49c6039d-7d6d-4260-a53a-ef17a7852bc8 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 200 len: 1227 microversion: 2.1 time: 0.101215 May 26 18:18:29.164730 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 588/1160] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:29 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 1227 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:18:29.312795 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.313461 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.320569 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.327618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.327618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.327618 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.336611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 HTTP/1.1 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:29.338323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.340111 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '8ee424ca-9145-4ca3-ad5c-f6db33739399'} May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:29.341046 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.342658 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:29.344235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:29.344235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-2db6fb19-35fb-472a-9518-6bb2ccea8546 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 404 len: 111 microversion: 2.1 time: 0.031716 May 26 18:18:29.344235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 573/1161] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:29 2022] DELETE /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:29.349020 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:29.349641 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 8ee424ca-9145-4ca3-ad5c-f6db33739399] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:29.355628 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.356073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.356836 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:29.357267 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:29.373143 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 HTTP/1.1 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:18:29.374794 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.376545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '8ee424ca-9145-4ca3-ad5c-f6db33739399'} May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:29.377416 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. May 26 18:18:29.379093 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:29.381432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 8ee424ca-9145-4ca3-ad5c-f6db33739399 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:29.381432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-42c1226d-0983-4ad3-ae01-c98fb84ec028 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399" status: 404 len: 111 microversion: 2.1 time: 0.031439 May 26 18:18:29.381432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 589/1162] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:29 2022] GET /compute/v2.1/servers/8ee424ca-9145-4ca3-ad5c-f6db33739399 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:30.181644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:30.182579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] [instance: adfbfda7-6eaf-45cc-92d8-e4b42a1143f4] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:30.188894 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.189389 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.190150 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.190585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.204924 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] HTTP exception thrown: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Request method failure captured: May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 HTTP/1.1 May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8Mq1wn4Mo6bvrNl-vyrXZmtb-wCJwHG6tA3bCnOFRs1-1hSU22XMbjJhU05Vf-k8ymnyqwIgDi4ESaOn15Wp77S70BGLn338GjFtoE_-bcAK2puKK3dpPRwDGs_IZnHtptsNVv19uJr6DhCO2EgS-Om0Yb0jPLAQvqaC-HdT6-1t6Y May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: a50fbd483e2e4d8886ae5d6341af7dcb May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestShelveInstance-1158555183 May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:30.208904 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a50fbd483e2e4d8886ae5d6341af7dcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/a50fbd483e2e4d8886ae5d6341af7dcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/a50fbd483e2e4d8886ae5d6341af7dcb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_a50fbd483e2e4d8886ae5d6341af7dcb", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestShelveInstance-1158555183 May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: a50fbd483e2e4d8886ae5d6341af7dcb May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestShelveInstance-1158555183 May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestShelveInstance-1158555183-project May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: cdc1042ea3b54768ab87e1f66e74ec1c May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestShelveInstance-1158555183-project May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. May 26 18:18:30.214585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': 'adfbfda7-6eaf-45cc-92d8-e4b42a1143f4'} May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:30.216564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. May 26 18:18:30.218074 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.219473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Returning 404 to user: Instance adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:30.219473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-88de42ba-873c-4904-8335-893248d24132 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4" status: 404 len: 111 microversion: 2.1 time: 0.033124 May 26 18:18:30.219473 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 574/1163] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:30 2022] GET /compute/v2.1/servers/adfbfda7-6eaf-45cc-92d8-e4b42a1143f4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:30.454992 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-642eebde-3741-4f98-834b-12dfd80e8429 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] Calling method '.version_select at 0x7f4b89710ca0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:30.581984 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-642eebde-3741-4f98-834b-12dfd80e8429 tempest-TestShelveInstance-1158555183 tempest-TestShelveInstance-1158555183-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809947172" status: 202 len: 0 microversion: 2.1 time: 0.130995 May 26 18:18:30.582740 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 590/1164] 10.222.0.121 () {58 vars in 1258 bytes} [Thu May 26 18:18:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809947172 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:18:30.689588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:30.690132 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:30.697118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.697579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.698357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.698801 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.712990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d HTTP/1.1 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:30.714582 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.716215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '86aa96be-ceb5-4d4d-8233-5f24483b0d3d'} May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:30.717115 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.718470 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:30.720045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:30.720045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bf0ab633-8600-4e8f-bdbe-a84ebbdcb06c tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 404 len: 111 microversion: 2.1 time: 0.030347 May 26 18:18:30.720045 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 575/1165] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:18:30 2022] DELETE /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:30.725439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:30.726098 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] [instance: 86aa96be-ceb5-4d4d-8233-5f24483b0d3d] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:18:30.734489 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.734998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.735769 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:18:30.736526 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:18:30.750536 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] HTTP exception thrown: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Request method failure captured: May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d HTTP/1.1 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8LDyCESV5Yh_6Z2rvJhstmTtBP-JuUicaVUeHGR_tfJBRRl0M5t4bqjy1DgN94noWIGQdD1bqyeVeE0zQ9EFBMNchHINAk61rBCorW05rLGqZj4eez8Opf0izyXnqdFFtAW1UL_mCml3fP69sKJifSSvm2UJRSXdZZ7pcn0RU5EBx8 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:18:30.752125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/d0c5ea7bbd294bd7b7729aa26b6c715c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_d0c5ea7bbd294bd7b7729aa26b6c715c", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: d0c5ea7bbd294bd7b7729aa26b6c715c May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1718248462 May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: 7df2a24143654445bcb96df81e960c9d May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-AttachVolumeTestJSON-1718248462-project May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.753806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '86aa96be-ceb5-4d4d-8233-5f24483b0d3d'} May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:30.754913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. May 26 18:18:30.759919 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:18:30.761282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] Returning 404 to user: Instance 86aa96be-ceb5-4d4d-8233-5f24483b0d3d could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:30.761282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-863d9d63-0add-4220-94cc-68075ed72d18 tempest-AttachVolumeTestJSON-1718248462 tempest-AttachVolumeTestJSON-1718248462-project] 10.222.0.121 "GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d" status: 404 len: 111 microversion: 2.1 time: 0.033451 May 26 18:18:30.761282 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 591/1166] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:18:30 2022] GET /compute/v2.1/servers/86aa96be-ceb5-4d4d-8233-5f24483b0d3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:18:36.625692 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0b3c9230-f98e-4e9c-b2b1-4a057245f631 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Action: 'create', calling method: .version_select at 0x7f4b8a3804c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1458934849", "metadata": {"Type": "work"}}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:18:37.410902 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0b3c9230-f98e-4e9c-b2b1-4a057245f631 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.913440 May 26 18:18:37.411648 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 576/1167] 10.222.0.121 () {60 vars in 1160 bytes} [Thu May 26 18:18:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 915 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) May 26 18:18:37.422670 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e287f61c-6c2c-4a18-b437-3ef094dd801a tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b8989c700>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:37.476876 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e287f61c-6c2c-4a18-b437-3ef094dd801a tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 200 len: 353 microversion: 2.1 time: 0.057894 May 26 18:18:37.477634 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 592/1168] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:18:37 2022] GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:38.490287 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a52a5a49-8724-4e02-8a59-179b3cafc819 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b8a351700>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.540325 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a52a5a49-8724-4e02-8a59-179b3cafc819 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 200 len: 354 microversion: 2.1 time: 0.054632 May 26 18:18:38.540895 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 577/1169] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:18:38 2022] GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:38.552271 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-96f447d0-cc69-48ae-a850-2bdf04e57776 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b89ab6280>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.604359 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-96f447d0-cc69-48ae-a850-2bdf04e57776 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 200 len: 354 microversion: 2.1 time: 0.056372 May 26 18:18:38.604939 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 593/1170] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:18:38 2022] GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:38.622215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-8bc960be-a822-4473-92e3-2d47cb304341 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b8a1ea9d0>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.912401 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-8bc960be-a822-4473-92e3-2d47cb304341 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "DELETE /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 202 len: 0 microversion: 2.1 time: 0.294217 May 26 18:18:38.913013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 578/1171] 10.222.0.121 () {58 vars in 1252 bytes} [Thu May 26 18:18:38 2022] DELETE /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:18:38.921155 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-90df3546-06a4-411d-9197-323d6afdb460 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b8972d9d0>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:38.973224 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-90df3546-06a4-411d-9197-323d6afdb460 tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 200 len: 353 microversion: 2.1 time: 0.055286 May 26 18:18:38.973822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 594/1172] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:18:38 2022] GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:18:39.986032 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fe07f486-5f98-4182-b547-68e3937fe8fc tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Calling method '.version_select at 0x7f4b8a380d30>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:18:40.014480 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-fe07f486-5f98-4182-b547-68e3937fe8fc tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] HTTP exception thrown: Volume 736af236-4901-467c-b932-315bc338242f could not be found. May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fe07f486-5f98-4182-b547-68e3937fe8fc tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Request method failure captured: May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f HTTP/1.1 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8R8-tzObWoQ2zT5Z-1d44A7YUqKt8AkvKVWSbYZCifzRkWVXPPJqSl_g1-Abg1SeSI02Xk1Ef3DkQrfQrfGSFutuxtffL0hyrvb31XxTQ89kMSdVl6XL8NyRe0qgtr9phJzUAjlUHMA91PRsJCzkSex0YLhzYV1eoCjVosNPZ-BNS8 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 885d9016a02e4694aed3568d0c76d88f May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-VolumesGetTestJSON-766826709 May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:18:40.016542 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/885d9016a02e4694aed3568d0c76d88f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/885d9016a02e4694aed3568d0c76d88f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/885d9016a02e4694aed3568d0c76d88f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_885d9016a02e4694aed3568d0c76d88f", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-VolumesGetTestJSON-766826709 May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 885d9016a02e4694aed3568d0c76d88f May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-VolumesGetTestJSON-766826709 May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-VolumesGetTestJSON-766826709-project May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: 0ef796c0658a4cd6b0f42dc32d8ca838 May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-VolumesGetTestJSON-766826709-project May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Volume 736af236-4901-467c-b932-315bc338242f could not be found. May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'id': '736af236-4901-467c-b932-315bc338242f'} May 26 18:18:40.018189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 736af236-4901-467c-b932-315bc338242f could not be found. (HTTP 404) (Request-ID: req-d5426e3f-ca7d-4e94-882f-66c889f4e7ae) May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:40.019239 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 18:18:40.021595 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 736af236-4901-467c-b932-315bc338242f could not be found. May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 18:18:40.023223 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 736af236-4901-467c-b932-315bc338242f could not be found. May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 736af236-4901-467c-b932-315bc338242f could not be found. May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fe07f486-5f98-4182-b547-68e3937fe8fc tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] Returning 404 to user: Volume 736af236-4901-467c-b932-315bc338242f could not be found. {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fe07f486-5f98-4182-b547-68e3937fe8fc tempest-VolumesGetTestJSON-766826709 tempest-VolumesGetTestJSON-766826709-project] 10.222.0.121 "GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f" status: 404 len: 109 microversion: 2.1 time: 0.036325 May 26 18:18:40.024628 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 579/1173] 10.222.0.121 () {58 vars in 1249 bytes} [Thu May 26 18:18:39 2022] GET /compute/v2.1/os-volumes/736af236-4901-467c-b932-315bc338242f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:19:41.900487 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:41.901228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:41.905770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b527716a-24ca-4fdf-b689-a8f4fa89a5b2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'create', calling method: .version_select at 0x7f4b8989c700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-494749967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDi4XONc6YXf9DZ0x8k6nRpSSFWqCHTDH5OE8/tT+rqFnw1gvCmFE939Aj4GxlKIIrVhcaSb6j+YJwYb/kTUS2CwMdCcfHNfty5ltzdX4MVokP0tOvxUQeZu1fAnKW7dA=="}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:41.919814 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-b527716a-24ca-4fdf-b689-a8f4fa89a5b2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Getting quotas for project 5950d9e178c2442cb0c62214d1eee60e. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:41.923647 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.quota [None req-b527716a-24ca-4fdf-b689-a8f4fa89a5b2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Getting quotas for user e88e293efd2442d586abc01e621ac415 and project 5950d9e178c2442cb0c62214d1eee60e. Resources: {'key_pairs'} {{(pid=130099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:42.036139 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b527716a-24ca-4fdf-b689-a8f4fa89a5b2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.137516 May 26 18:19:42.036770 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 595/1174] 10.222.0.121 () {60 vars in 1163 bytes} [Thu May 26 18:19:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:42.084391 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:42.085212 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:42.090189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1645126224", "imageRef": "5c945633-e867-4a94-8cab-51cda954f390", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-494749967", "networks": [{"uuid": "d72f7c77-4ae4-44ca-9aa3-8195b936efea"}]}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:42.143025 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.network.neutron [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] validate_networks() for [('d72f7c77-4ae4-44ca-9aa3-8195b936efea', None, None, None, None, None)] {{(pid=130100) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 18:19:42.520543 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Flavor limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 18:19:42.520988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Image limits 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 18:19:42.521464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Flavor pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 18:19:42.521907 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Image pref 0:0:0 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 18:19:42.522323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.virt.hardware [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 18:19:42.531540 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:42.531982 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:42.532780 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:42.533219 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:42.551096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Getting quotas for project 5950d9e178c2442cb0c62214d1eee60e. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 18:19:42.556368 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.quota [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Getting quotas for user e88e293efd2442d586abc01e621ac415 and project 5950d9e178c2442cb0c62214d1eee60e. Resources: {'ram', 'instances', 'cores'} {{(pid=130100) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 18:19:42.567044 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Going to run 1 instances... {{(pid=130100) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 18:19:42.569238 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5c945633-e867-4a94-8cab-51cda954f390',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130100) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 18:19:42.713106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f200cae0-1ed6-4eec-a530-4f8fe450184b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.629943 May 26 18:19:42.713749 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 580/1175] 10.222.0.121 () {60 vars in 1151 bytes} [Thu May 26 18:19:42 2022] POST /compute/v2.1/servers => generated 382 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 26 18:19:42.728430 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-830dcc76-0b14-40cd-a940-594566445cfe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:42.729540 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-830dcc76-0b14-40cd-a940-594566445cfe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:42.957883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-830dcc76-0b14-40cd-a940-594566445cfe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:42.966015 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-830dcc76-0b14-40cd-a940-594566445cfe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1262 microversion: 2.1 time: 0.245721 May 26 18:19:42.966575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 596/1176] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:42 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1262 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:43.984372 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f045d6da-c1fe-400c-a772-e3504de01f09 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:43.984990 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f045d6da-c1fe-400c-a772-e3504de01f09 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:44.037376 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f045d6da-c1fe-400c-a772-e3504de01f09 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:44.044875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f045d6da-c1fe-400c-a772-e3504de01f09 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1262 microversion: 2.1 time: 0.064885 May 26 18:19:44.045438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 581/1177] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:43 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1262 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:45.062390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:45.063106 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:45.069564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:45.070026 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:45.070806 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:45.071883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:45.137849 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:45.145240 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-118aeb15-844f-4655-9688-8490ca8e0f94 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1314 microversion: 2.1 time: 0.086800 May 26 18:19:45.145803 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 597/1178] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:45 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1314 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:46.162340 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:46.162993 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:46.176709 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:46.177164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:46.178159 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:46.178802 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:46.461201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:46.469435 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-594b3885-a6ef-4852-b532-9b76a790eba2 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.311293 May 26 18:19:46.479560 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 582/1179] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:46 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:47.486671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:47.487319 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:47.495252 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.495696 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.496505 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:47.496943 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:47.632516 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:47.641674 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-048426e9-31f8-4375-811c-9c1f8ab67855 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.158759 May 26 18:19:47.642267 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 598/1180] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:47 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:48.662683 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:48.663930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:48.670319 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:48.670778 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:48.671590 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:48.672262 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:48.817141 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:48.825282 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-986a3c17-85b6-4dfa-b0a3-0c7796d8c337 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.170054 May 26 18:19:48.825848 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 583/1181] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:48 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:49.843500 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:49.844251 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:49.853815 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.854268 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.855086 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:49.855521 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:49.997000 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:50.004650 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0bbf7eed-b57f-47af-b961-b291b0cd0164 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.165236 May 26 18:19:50.005207 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 599/1182] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:49 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:51.021877 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:51.022527 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:51.030216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:51.030684 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:51.031503 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:51.031948 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:51.189626 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:51.200096 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fea5fe9d-0518-4401-a83c-eab7583432d1 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.182097 May 26 18:19:51.200683 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 584/1183] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:51 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:52.220288 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:52.221564 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:52.232741 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:52.233380 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:52.234432 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:52.234998 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:52.483050 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:52.501034 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-9a6e34c5-3bfa-4a78-8fe6-6d5ba300363e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.286620 May 26 18:19:52.501987 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 600/1184] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:52 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:53.524405 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:53.525077 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:53.527294 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=2 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:53.532183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.532629 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.533396 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:53.533828 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:53.667995 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:53.675654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0ed0eb18-cb8d-442f-9ba1-16bdf29b401c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.155131 May 26 18:19:53.676216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 585/1185] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:53 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:54.692204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:54.692813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:54.694946 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=6 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:54.699925 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:54.712204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:54.712204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:54.712204 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:54.835228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:54.842980 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b86704dd-5f9c-4efe-9ca8-d4152e60cc32 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.154745 May 26 18:19:54.843544 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 601/1186] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:54 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:55.859947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:55.860539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:55.862393 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell0:SELECT=8 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:55.867857 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.868328 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:55.869118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:55.870357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:56.011093 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:56.016696 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-a683cf9d-b631-462b-ae33-d4727a7e1dbf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.160492 May 26 18:19:56.017352 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 586/1187] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:55 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:19:57.034328 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:57.035077 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:57.043128 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.043587 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.044379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.044822 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.205192 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:57.216296 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bbf9778a-b297-4aee-b212-4549b0e41092 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.185656 May 26 18:19:57.218070 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 602/1188] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:57 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:57.507988 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-af7772ce-47ee-45c7-8f9c-2a412af2197d req-d57894e8-3f8a-4525-922f-e533e18ba096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:19:57.517717 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-af7772ce-47ee-45c7-8f9c-2a412af2197d req-d57894e8-3f8a-4525-922f-e533e18ba096 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:57.518497 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-af7772ce-47ee-45c7-8f9c-2a412af2197d req-d57894e8-3f8a-4525-922f-e533e18ba096 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:57.537277 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-af7772ce-47ee-45c7-8f9c-2a412af2197d req-d57894e8-3f8a-4525-922f-e533e18ba096 service nova] Creating event network-changed:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:19:57.542888 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-af7772ce-47ee-45c7-8f9c-2a412af2197d req-d57894e8-3f8a-4525-922f-e533e18ba096 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 May 26 18:19:57.543667 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 587/1189] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:19:58.235317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:58.235916 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:58.242673 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.243168 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.243933 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:58.244387 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:58.384531 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:58.392695 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ab53cf15-5873-42b3-8d67-beb354e77f61 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.161273 May 26 18:19:58.393355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 603/1190] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:58 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:19:59.410813 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:19:59.411535 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:19:59.418297 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:59.418750 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:59.419585 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:19:59.420033 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:19:59.555373 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:19:59.563035 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-ad572fd8-0aaf-4cb4-b838-3ad9bc658dc0 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.156941 May 26 18:19:59.563596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 588/1191] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:19:59 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:00.579853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:00.580475 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:00.587246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.587706 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.588483 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:00.588926 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:00.726206 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:00.733900 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-e06238b5-72ae-4f2d-a746-d5d78e9be60b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.157887 May 26 18:20:00.734479 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 604/1192] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:00 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:01.752306 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:01.752926 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:01.759588 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.760303 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.761070 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:01.761630 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:01.892431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:01.900452 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-395add92-8de7-41a0-9943-161d46ea1166 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.152424 May 26 18:20:01.901030 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 589/1193] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:01 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:02.917767 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:02.918345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:02.925091 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:02.925537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:02.926352 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:02.926788 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:03.297064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:03.304559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-bdc855e7-f29c-4d5e-aef9-c4d68be91a63 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.390698 May 26 18:20:03.305112 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 605/1194] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:02 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:04.322544 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:04.323308 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:04.331122 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.331577 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.332359 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.332801 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.396671 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-b7f8987f-491e-4406-88dc-b11865ae795d req-34de800b-fbf8-4146-a626-35f91b615604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "name": "network-vif-plugged", "status": "completed", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:04.406117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b7f8987f-491e-4406-88dc-b11865ae795d req-34de800b-fbf8-4146-a626-35f91b615604 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:04.406598 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-b7f8987f-491e-4406-88dc-b11865ae795d req-34de800b-fbf8-4146-a626-35f91b615604 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:04.419232 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-b7f8987f-491e-4406-88dc-b11865ae795d req-34de800b-fbf8-4146-a626-35f91b615604 service nova] Creating event network-vif-plugged:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:20:04.424573 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-b7f8987f-491e-4406-88dc-b11865ae795d req-34de800b-fbf8-4146-a626-35f91b615604 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034314 May 26 18:20:04.425185 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 606/1195] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:04.472269 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:04.480627 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-fcad41fd-636d-4d8d-9d72-da7dcb60680a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.162036 May 26 18:20:04.481189 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 590/1196] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:04 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:05.498710 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:05.499427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:05.505688 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.506136 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.506928 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:05.507360 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:05.641640 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:05.649043 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-eb941e04-14e3-4e69-ac12-67f416c320ec tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.155741 May 26 18:20:05.649609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 607/1197] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:05 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:06.665987 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:06.666463 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:06.674911 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.675367 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.676173 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:06.676611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:06.807172 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:06.816197 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-55b1301e-4185-4e21-88d1-520123fbc5cc tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1362 microversion: 2.1 time: 0.154491 May 26 18:20:06.837164 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 591/1198] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:06 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:07.833937 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:07.834601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:07.841546 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.842219 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.843117 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:07.843601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:07.978556 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:07.986458 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-0566d0b8-3cae-4d9d-87f6-577e272ef231 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1551 microversion: 2.1 time: 0.156691 May 26 18:20:07.987064 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 608/1199] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:08.003408 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.004022 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.011066 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.011528 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.012329 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.012771 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.147984 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.155819 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-918d040c-b918-4e86-a15f-4531f77f1db8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1551 microversion: 2.1 time: 0.156787 May 26 18:20:08.156394 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 592/1200] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:07 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:08.171839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.175216 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.175982 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Searching by: {'deleted': False, 'project_id': '5950d9e178c2442cb0c62214d1eee60e'} {{(pid=130099) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 18:20:08.183094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.183545 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.184345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.184853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.276477 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.multi_cell_list [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 18:20:08.369979 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a5409f0e-8621-489b-bf18-f3111aadb933 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.202279 May 26 18:20:08.370575 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 609/1201] 10.222.0.121 () {58 vars in 1129 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers => generated 345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:08.381515 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:08.382184 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:08.388792 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.389248 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.390051 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:08.390490 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:08.519012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:08.526642 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5e647ffe-689f-453c-9d61-ad3c6a62d326 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1551 microversion: 2.1 time: 0.148980 May 26 18:20:08.527242 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 593/1202] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:08 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:10.452707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23de666b-931c-48d4-99d5-d4283cb09772"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:10.453771 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:10.460081 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.460537 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:10.461316 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:10.461758 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:11.145550 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-a34c4aa2-57ec-42f5-ae0d-0eb3f027624c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697633 May 26 18:20:11.146404 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 610/1203] 10.222.0.121 () {60 vars in 1327 bytes} [Thu May 26 18:20:10 2022] POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 18:20:18.703611 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:18.704232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:18.706841 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:18.707654 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=70 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:18.712323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.712781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.714106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:18.714106 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:18.848138 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:18.856118 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-31184e49-f428-40ab-a96a-f5e31963cb35 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1597 microversion: 2.1 time: 0.156293 May 26 18:20:18.856832 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 594/1204] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:18 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1597 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:20:20.771773 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell0:SELECT=2 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:20.772921 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:20.777236 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-23d7b842-e419-42da-8cb0-b9b19c49ddd0 req-0db00884-706b-4884-a922-3ed4675c2dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:20.787027 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-23d7b842-e419-42da-8cb0-b9b19c49ddd0 req-0db00884-706b-4884-a922-3ed4675c2dcf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:20.787856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-23d7b842-e419-42da-8cb0-b9b19c49ddd0 req-0db00884-706b-4884-a922-3ed4675c2dcf service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:20.792457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:20.807126 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-23d7b842-e419-42da-8cb0-b9b19c49ddd0 req-0db00884-706b-4884-a922-3ed4675c2dcf service nova] Creating event network-changed:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:20:20.813381 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-23d7b842-e419-42da-8cb0-b9b19c49ddd0 req-0db00884-706b-4884-a922-3ed4675c2dcf service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042291 May 26 18:20:20.814023 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 611/1205] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:22.981260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-120771035"}} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:22.981828 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:22.989094 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.989551 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:22.990323 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:22.990767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.116031 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.network.security_group_api [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Adding security group 59d305eb-d9b0-408d-8f71-d3c993f69c32 to port 783f9133-ec48-4e78-94c4-4284b4dd604c May 26 18:20:23.607941 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-9baa0a24-79d3-421a-a923-c2769e953aee tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action" status: 202 len: 0 microversion: 2.1 time: 0.630652 May 26 18:20:23.610207 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 595/1206] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:20:22 2022] POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:20:23.630279 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:20:23.631158 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:20:23.638056 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.638753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.639964 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.640596 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.716103 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-8a10d03e-7f10-4e1f-a278-e511e8152f1d req-2af0d2c9-7b74-4fc7-a287-5f3b2a252763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:20:23.725709 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-8a10d03e-7f10-4e1f-a278-e511e8152f1d req-2af0d2c9-7b74-4fc7-a287-5f3b2a252763 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:20:23.726515 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-8a10d03e-7f10-4e1f-a278-e511e8152f1d req-2af0d2c9-7b74-4fc7-a287-5f3b2a252763 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:20:23.746333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-8a10d03e-7f10-4e1f-a278-e511e8152f1d req-2af0d2c9-7b74-4fc7-a287-5f3b2a252763 service nova] Creating event network-changed:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:20:23.751929 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-8a10d03e-7f10-4e1f-a278-e511e8152f1d req-2af0d2c9-7b74-4fc7-a287-5f3b2a252763 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139097 May 26 18:20:23.753246 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 612/1207] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:20:23.821337 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:20:23.834517 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-21f2f8af-351e-4d39-b398-6c54d5741212 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1762 microversion: 2.1 time: 0.215525 May 26 18:20:23.835139 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 596/1208] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:20:23 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1762 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:21.566433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=4 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:21.571578 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:21:21.572599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.578808 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.585125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.585125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.585125 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.776747 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4e5a9506-c25b-4a46-a6fa-6e3e9206ae92 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action" status: 202 len: 0 microversion: 2.1 time: 0.211631 May 26 18:21:21.777469 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 613/1209] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:21:21 2022] POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:21:21.786563 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:21.787211 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:21.789384 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=6 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:21.790169 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=16 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:21.795123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.795579 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.796366 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:21.796808 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:21.948674 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:21.956772 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-f5460234-2097-4dda-a814-4c5d056cad47 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1754 microversion: 2.1 time: 0.175067 May 26 18:21:21.957345 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 597/1210] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:21 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:22.735960 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:21:22.736439 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:21:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:21:22.975880 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:22.976601 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:22.982913 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:22.983390 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:22.984140 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:22.984571 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:23.127614 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:23.135718 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4678193e-666b-4622-bc5b-a954a6a21f48 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.165216 May 26 18:21:23.136286 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 614/1211] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:22 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:21:24.153451 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:24.154059 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:24.160753 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.161195 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.161947 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:24.162433 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:24.306109 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:24.314218 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-0d1e7076-b0a4-4e78-9880-0537554f2617 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.164650 May 26 18:21:24.314919 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 598/1212] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:24 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:25.331345 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:25.331962 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:25.338152 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.338609 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.339411 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:25.339853 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:25.486293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:25.494727 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ce599daa-eba6-4f6e-893f-f2dae1134712 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.167345 May 26 18:21:25.495309 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 615/1213] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:25 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:26.512228 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:26.512816 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:26.519244 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.519694 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.520444 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:26.520876 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:26.660134 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:26.668827 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-3dea3d97-2d10-4b1f-bcc3-b875b2412adf tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.160434 May 26 18:21:26.669398 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 599/1214] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:26 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:27.685675 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:27.686283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:27.692691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.693150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.693908 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:27.694355 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:27.836959 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:27.844699 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-b13c55df-74f2-4a70-958f-6c59a6df845a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.163168 May 26 18:21:27.845259 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 616/1215] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:27 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:28.861466 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:28.862087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:28.869529 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:28.869978 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:28.870741 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:28.871246 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:29.014459 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:29.022415 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-bb8f917d-5bda-41db-a633-9001f8121f7c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.164897 May 26 18:21:29.023012 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 600/1216] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:28 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:30.039427 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:30.040199 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:30.046371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.046839 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.047600 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:30.048035 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:30.194001 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:30.202459 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-47ce478f-dd5b-40a8-a5ac-6c9673652f9f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.166858 May 26 18:21:30.203053 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 617/1217] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:30 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:31.219392 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:31.220039 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:31.226227 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.227433 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.228201 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:31.228597 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:31.367915 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:31.375776 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-30f99d24-745c-4dac-8675-75cbfe178478 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.160273 May 26 18:21:31.377024 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 601/1218] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:31 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:32.393580 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:32.394283 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:32.402006 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.402456 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.403333 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:32.403691 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:32.548169 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:32.556497 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-3fc1cc23-562d-4103-b1a7-0de1a43a79b9 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1759 microversion: 2.1 time: 0.166794 May 26 18:21:32.557293 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 618/1219] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:32 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:21:33.573937 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:21:33.574573 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:21:33.581147 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.581599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.582355 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:21:33.582789 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:21:33.721087 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:21:33.731310 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-5e398053-0a12-4819-926e-52465e9bfa4a tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1762 microversion: 2.1 time: 0.161201 May 26 18:21:33.732097 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 602/1220] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:21:33 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1762 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:37.067599 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_api:SELECT=12 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.068302 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG dbcounter [-] [130099] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.072298 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-120771035"}} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:37.072878 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:37.079662 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.080524 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.080915 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.081361 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.215072 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.network.security_group_api [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Removing security group 59d305eb-d9b0-408d-8f71-d3c993f69c32 from port 783f9133-ec48-4e78-94c4-4284b4dd604c May 26 18:22:37.640433 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7165fb8a-bcd6-42f5-b859-3dac94b959ad tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action" status: 202 len: 0 microversion: 2.1 time: 0.573997 May 26 18:22:37.641322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 619/1221] 10.222.0.121 () {60 vars in 1282 bytes} [Thu May 26 18:22:37 2022] POST /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:37.705532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [req-cec46413-8246-46c1-b79e-9bbb0dbcfc89 req-2fe97730-a5c8-4fdd-92fc-b596cadbe9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:37.705532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_api:SELECT=12 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.705532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG dbcounter [-] [130100] Writing DB stats nova_cell1:SELECT=36 {{(pid=130100) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.705532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-cec46413-8246-46c1-b79e-9bbb0dbcfc89 req-2fe97730-a5c8-4fdd-92fc-b596cadbe9b9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:37.705532 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [req-cec46413-8246-46c1-b79e-9bbb0dbcfc89 req-2fe97730-a5c8-4fdd-92fc-b596cadbe9b9 service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:37.707782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.compute.server_external_events [req-cec46413-8246-46c1-b79e-9bbb0dbcfc89 req-2fe97730-a5c8-4fdd-92fc-b596cadbe9b9 service nova] Creating event network-changed:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:22:37.707782 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [req-cec46413-8246-46c1-b79e-9bbb0dbcfc89 req-2fe97730-a5c8-4fdd-92fc-b596cadbe9b9 service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054841 May 26 18:22:37.708260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 603/1222] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:38.910208 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:38.910813 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:38.917217 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.917761 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:38.918621 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:38.919182 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.009731 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.objects.instance [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lazy-loading 'services' on Instance uuid 7f9a69c2-1d87-4954-8dad-7b13da568734 {{(pid=130099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:39.221719 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4ea42554-61f9-4139-85b4-c423f701036c tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments/23de666b-931c-48d4-99d5-d4283cb09772" status: 202 len: 0 microversion: 2.1 time: 0.316429 May 26 18:22:39.222315 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 620/1223] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:22:38 2022] DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments/23de666b-931c-48d4-99d5-d4283cb09772 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 18:22:39.232713 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:39.234216 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:39.246112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.246112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.246112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.246112 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.272910 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-869ccc2e-e214-47ad-8828-1566797b3b78 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 May 26 18:22:39.277875 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 604/1224] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:22:39 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:39.735262 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-72620906-aa2a-4c13-a063-1cf75f7a8cfc req-5c60eb87-413c-4ada-9745-134603868efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:39.743809 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-72620906-aa2a-4c13-a063-1cf75f7a8cfc req-5c60eb87-413c-4ada-9745-134603868efc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:39.744252 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-72620906-aa2a-4c13-a063-1cf75f7a8cfc req-5c60eb87-413c-4ada-9745-134603868efc service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:39.756338 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-72620906-aa2a-4c13-a063-1cf75f7a8cfc req-5c60eb87-413c-4ada-9745-134603868efc service nova] Creating event network-changed:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:22:39.761455 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-72620906-aa2a-4c13-a063-1cf75f7a8cfc req-5c60eb87-413c-4ada-9745-134603868efc service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030323 May 26 18:22:39.762066 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 621/1225] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:40.285437 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:40.286377 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:40.293127 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.293584 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.294357 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:40.294797 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:40.324348 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-73a70539-71b0-480c-ab43-159262c86d1b tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 May 26 18:22:40.324905 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 605/1226] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:22:40 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:41.337317 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:41.338264 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:41.344727 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.345174 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.345941 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.346379 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.375766 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-315b5996-44ad-487f-866d-75ff7bca7ebe tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043259 May 26 18:22:41.376322 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 622/1227] 10.222.0.121 () {58 vars in 1306 bytes} [Thu May 26 18:22:41 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 18:22:41.386100 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:41.386599 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:41.393215 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.393764 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.394539 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:41.395260 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:41.470780 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.wsgi [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] HTTP exception thrown: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 is not attached to volume 23de666b-931c-48d4-99d5-d4283cb09772 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Request method failure captured: May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: request: DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments/23de666b-931c-48d4-99d5-d4283cb09772 HTTP/1.1 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept: application/json May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Accept-Encoding: identity May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Connection: close May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Length: 0 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Content-Type: application/json May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Host: 10.222.0.121 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Openstack-System-Scope: None May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: User-Agent: python-urllib3/1.26.9 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Auth-Token: gAAAAABij8SsSwybyVGNPue-RArIHNHSnBCN9xmpqoWJOjWJVGdkppQfiow3eFzC0Z7QaIwZThsNB2X9SWlmDEFxZfVi8XaGDu0FlxVpXyqUaiyqoYQe6haYI7wtHfFTzM6N6qYeiWf_eCwQc-2pCbWTHSsGD67qhvWyFmtXRAjxADDZgtPjOyg May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Id: None May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Domain-Name: None May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Identity-Status: Confirmed May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Is-Admin-Project: True May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Id: default May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Domain-Name: Default May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Id: 5950d9e178c2442cb0c62214d1eee60e May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Project-Name: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Role: member,reader May 26 18:22:41.473208 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Roles: member,reader May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5950d9e178c2442cb0c62214d1eee60e", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Id: 5950d9e178c2442cb0c62214d1eee60e May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User: tempest-TestMinimumBasicScenario-1515560846-project May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Id: default May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Domain-Name: Default May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Id: e88e293efd2442d586abc01e621ac415 May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: X-User-Name: tempest-TestMinimumBasicScenario-1515560846-project May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: method: > May 26 18:22:41.475182 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: exception: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 is not attached to volume 23de666b-931c-48d4-99d5-d4283cb09772 May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: action_args: {'server_id': '7f9a69c2-1d87-4954-8dad-7b13da568734', 'id': '23de666b-931c-48d4-99d5-d4283cb09772'} May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23de666b-931c-48d4-99d5-d4283cb09772. May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:41.476183 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 is not attached to volume 23de666b-931c-48d4-99d5-d4283cb09772 May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 is not attached to volume 23de666b-931c-48d4-99d5-d4283cb09772 May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: ERROR nova.api.openstack.wsgi May 26 18:22:41.477718 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Returning 404 to user: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 is not attached to volume 23de666b-931c-48d4-99d5-d4283cb09772 {{(pid=130100) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:41.479177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-4b363560-605c-4979-a87e-962f3ea9fd3e tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments/23de666b-931c-48d4-99d5-d4283cb09772" status: 404 len: 154 microversion: 2.1 time: 0.092642 May 26 18:22:41.479177 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 606/1228] 10.222.0.121 () {58 vars in 1420 bytes} [Thu May 26 18:22:41 2022] DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734/os-volume_attachments/23de666b-931c-48d4-99d5-d4283cb09772 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:42.733300 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:42.733816 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:42.740866 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.741707 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.742079 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:42.742522 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:42.767194 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Going to try to terminate instance {{(pid=130099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 18:22:43.021387 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-7aacd321-a55f-4d07-b8e4-67186b2f6112 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 204 len: 0 microversion: 2.1 time: 0.291444 May 26 18:22:43.021902 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 623/1229] 10.222.0.121 () {58 vars in 1243 bytes} [Thu May 26 18:22:42 2022] DELETE /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 18:22:43.029883 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:43.030491 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:43.037275 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.040564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.040564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:43.040564 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:43.173412 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:43.180916 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-60b09b82-2b48-44eb-b80a-0840fd720926 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1557 microversion: 2.1 time: 0.154837 May 26 18:22:43.181513 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 607/1230] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:22:43 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:44.199457 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:44.200158 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:44.207623 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.208094 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.208864 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:44.209301 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:44.335121 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.policy [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130099) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:44.342511 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-4820a1b3-c6d8-4794-89c0-eb12cc83600f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1557 microversion: 2.1 time: 0.147333 May 26 18:22:44.343114 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 624/1231] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:22:44 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:45.359464 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:45.360660 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:45.367211 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.367664 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.368431 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.368867 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.505818 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:45.513343 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-becd9aca-b91f-49cd-bc07-24c6342535d5 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1557 microversion: 2.1 time: 0.157830 May 26 18:22:45.513912 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 608/1232] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:22:45 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 18:22:45.753645 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [req-cefa90e1-6e8e-46d1-afb7-88b29506883b req-4a5c77ab-3383-4ae3-818d-948bee80b43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a69c2-1d87-4954-8dad-7b13da568734", "name": "network-vif-deleted", "tag": "783f9133-ec48-4e78-94c4-4284b4dd604c"}]} {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 18:22:45.761775 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-cefa90e1-6e8e-46d1-afb7-88b29506883b req-4a5c77ab-3383-4ae3-818d-948bee80b43f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:45.762228 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [req-cefa90e1-6e8e-46d1-afb7-88b29506883b req-4a5c77ab-3383-4ae3-818d-948bee80b43f service nova] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:45.773559 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.compute.server_external_events [req-cefa90e1-6e8e-46d1-afb7-88b29506883b req-4a5c77ab-3383-4ae3-818d-948bee80b43f service nova] Creating event network-vif-deleted:783f9133-ec48-4e78-94c4-4284b4dd604c for instance 7f9a69c2-1d87-4954-8dad-7b13da568734 on hv-cinder-83607 May 26 18:22:45.778509 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [req-cefa90e1-6e8e-46d1-afb7-88b29506883b req-4a5c77ab-3383-4ae3-818d-948bee80b43f service nova] 10.222.0.121 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149646 May 26 18:22:45.779150 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 625/1233] 10.222.0.121 () {64 vars in 1322 bytes} [Thu May 26 18:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 18:22:46.530013 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:46.530574 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.compute.api [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130100) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:46.537781 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.538232 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.539032 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.539469 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.571537 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:46.571985 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG oslo_concurrency.lockutils [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130100) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:46.572438 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.objects.instance [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lazy-loading 'fault' on Instance uuid 7f9a69c2-1d87-4954-8dad-7b13da568734 {{(pid=130100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 18:22:46.616002 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.policy [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88e293efd2442d586abc01e621ac415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5950d9e178c2442cb0c62214d1eee60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130100) authorize /opt/stack/nova/nova/policy.py:199}} May 26 18:22:46.622738 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-228cf43d-dfe8-4ef1-b2cc-f247ea1376b3 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 200 len: 1352 microversion: 2.1 time: 0.096685 May 26 18:22:46.623339 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 609/1234] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:22:46 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 18:22:47.641444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '>' {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:47.642418 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.compute.api [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] [instance: 7f9a69c2-1d87-4954-8dad-7b13da568734] Fetching instance by UUID {{(pid=130099) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 18:22:47.648966 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.649419 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.650181 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 18:22:47.650612 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG oslo_concurrency.lockutils [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Lock "1aa3fa86-c8c9-4c3d-99e8-137d16582b2d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 18:22:47.665532 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.wsgi [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] HTTP exception thrown: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Request method failure captured: May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: request: GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 HTTP/1.1 May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept: application/json May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Accept-Encoding: identity May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Connection: close May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Length: 0 May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Content-Type: application/json May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Host: 10.222.0.121 May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Openstack-System-Scope: None May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: User-Agent: python-urllib3/1.26.9 May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Auth-Token: gAAAAABij8SsSwybyVGNPue-RArIHNHSnBCN9xmpqoWJOjWJVGdkppQfiow3eFzC0Z7QaIwZThsNB2X9SWlmDEFxZfVi8XaGDu0FlxVpXyqUaiyqoYQe6haYI7wtHfFTzM6N6qYeiWf_eCwQc-2pCbWTHSsGD67qhvWyFmtXRAjxADDZgtPjOyg May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Id: None May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Domain-Name: None May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Identity-Status: Confirmed May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Is-Admin-Project: True May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Id: default May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Domain-Name: Default May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Id: 5950d9e178c2442cb0c62214d1eee60e May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Project-Name: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Role: member,reader May 26 18:22:47.667183 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Roles: member,reader May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/volume/v3/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121/compute/v2/5950d9e178c2442cb0c62214d1eee60e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.121:8080/v1/AUTH_5950d9e178c2442cb0c62214d1eee60e", "adminURL": "http://10.222.0.121:8080"}]}] May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Id: 5950d9e178c2442cb0c62214d1eee60e May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1515560846 May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User: tempest-TestMinimumBasicScenario-1515560846-project May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Id: default May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Domain-Name: Default May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Id: e88e293efd2442d586abc01e621ac415 May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: X-User-Name: tempest-TestMinimumBasicScenario-1515560846-project May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: method: > May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: exception: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. May 26 18:22:47.668856 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: action_args: {'id': '7f9a69c2-1d87-4954-8dad-7b13da568734'} May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: {{(pid=130099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 18:22:47.669739 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. May 26 18:22:47.671371 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: ERROR nova.api.openstack.wsgi May 26 18:22:47.672907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: DEBUG nova.api.openstack.wsgi [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Returning 404 to user: Instance 7f9a69c2-1d87-4954-8dad-7b13da568734 could not be found. {{(pid=130099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 18:22:47.672907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO nova.api.openstack.requestlog [None req-ce5a864f-8de7-4485-97aa-e2490ce98e7f tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734" status: 404 len: 111 microversion: 2.1 time: 0.032033 May 26 18:22:47.672907 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: [pid: 130099|app: 0|req: 626/1235] 10.222.0.121 () {58 vars in 1240 bytes} [Thu May 26 18:22:47 2022] GET /compute/v2.1/servers/7f9a69c2-1d87-4954-8dad-7b13da568734 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 18:22:47.679154 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: DEBUG nova.api.openstack.wsgi [None req-e859ddfe-c814-43fc-a9ea-02ccadc070b8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] Calling method '.version_select at 0x7f4b8a1ea280>' {{(pid=130100) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 18:22:47.770622 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO nova.api.openstack.requestlog [None req-e859ddfe-c814-43fc-a9ea-02ccadc070b8 tempest-TestMinimumBasicScenario-1515560846 tempest-TestMinimumBasicScenario-1515560846-project] 10.222.0.121 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-494749967" status: 202 len: 0 microversion: 2.1 time: 0.095177 May 26 18:22:47.771235 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: [pid: 130100|app: 0|req: 610/1236] 10.222.0.121 () {58 vars in 1273 bytes} [Thu May 26 18:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-494749967 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 18:24:42.744995 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:24:42.745620 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:24:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:24:49.499073 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:24:49.499752 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:24:51.380711 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:24:51.381295 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:24:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:25:01.665936 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:25:01.666671 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:25:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:25:08.013249 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:25:08.014025 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:25:20.153306 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:25:20.153883 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:25:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:02.754462 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:02.755237 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:09.507444 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:09.508164 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:28:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:11.389123 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:11.389773 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:28:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:21.675030 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:21.675767 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:28:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:28.021930 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:28.022644 dv-cinder-836073-5-iscsi devstack@n-api.service[130100]: Thu May 26 18:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 18:28:40.161257 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 18:28:40.161817 dv-cinder-836073-5-iscsi devstack@n-api.service[130099]: Thu May 26 18:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!